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SUMMARY 


Ibltiple  Wiener  integrals  and  stocliastic  integrals  are  defined  for 
Gaussian  processes,  extending  the  related  notions  for  the  Wiener  process.  It 
is  shown  that  every  L^- functional  of  a Gaussian  process  admits  an  adapted 
stochastic  integral  representation  and  an  orthogonal  series  expansion  in  terns 
of  multiple  Wiener  integrals.  Also  soute  results  of  Wiener's  theory  of  non- 
linear noise  are  generalized  to  noises  other  than  white. 
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J.  IilTRCDUCTIOi! 


Let  us  first  fix  our  basic  notation  and  terminology.  We  will  consider 
throughout  a zero  ncan  (for  simplicity)  Gaussian  process  X = (X^,  tcT) 
defined  on  a probability  space  (fi,8,P).  T will  be  an  interval  of  the  real 
line,  even  though  r;iore  general  index  sets  could  clearly  be  used.  8 is 
usually  taken  to  be  6(X),  the  o- field  generated  by  the  process  X,  or  8(X) , 
the  completion  of  B(X).  There  are  tvw  important  Hilbert  spaces  associated  to 
a Gaussian  process.  The  nonlinear  space  of  X,  L2(X)  * L2 (ft,5(X) ,P) , consists 
of  all  3 (X) -measurable  random,  variables  with  finite  second  moment  which  are 
called  (nonlinear)  L2- functionals  of  X.  The  linear  space  of  X,  I-I(X),  is 
the  closed  s'.ib space  of  L2(X)  spanned  by  X^.  , t c T,  and  its  elenents  are 
called  linear  L2- functionals  of  X. 

Tie  first  useful  notion  in  the  study  of  the  nonlinear  space  of  a Wiener 
process  is  the  iiultiple  Wiener  Integral.  This  notion  was  first  introduced  by 
Wiener  (1932),  who  termed  it  "Polynomial  Chaos",  and  was  redefined  in  a 
somewhat  deeper  way  by  Ito  (1951).  Ito  showed  that  his  multiple  integrals  of 
different  degree  have  the  important  property  of  being  mutually  ortliogonal  and 
also  presented  their  connection  with  the  celebrated  Fourier-Hermite  expansion 
of  L2- functionals  of  Cameron  and  iiartin  (1947).  Subsequently,  Ito  (1956) 
extended  to  general  processes  with  stationary  independent  increments  the  Wiener 
Ito  expansion  of  L2- functionals  in  terms  of  multiple  Wiener  integrals.  In  his 
important  work  on  nonlinear  problems  Wiener  (1958)  reinterpreted  the  multiple 
Wiener  integrals  for  a Wiener  process  in  an  extremely  simple  and  intuitive  way 
and  made  some  interesting  applications.  Finally  Meveu  (1963)  and  Kallianpur 


I 


! 


2 

(1970)  studied  the  connection  between  the  nonlinear  space  of  a Gaussian 
process  and  the  tensor  products  of  its  linear  space,  which  sheds  new  light  and 
gives  more  insight  on  the  structure  of  the  nonlinear  space. 

The  first  objective  of  this  work  is  to  define  multiple  Wiener  integrals 
for  general  Gaussian  processes  and  to  use  then  in  extending  Wiener's  theory  of 
nonlinear  noise.  The  groundwork  is  in  Section  1 where  the  Hilbert  spaces  of  \ 
appropriate  integrands  for  the  multiple  Wiener  integrals  are  introduced  and  > 

studied.  The  multiple  Wiener  integrals  are  then  defined  in  Section  2.  Section 
S includes  the  extension  of  sane  basic  results  of  Wiener's  nonlinear  noise 
theory  from  noises  generated  by  the  Wiener  process  to  noises  generated 
similarly  by  processes  with  stationary  Gaussian  increments  (Theorems  5.1  and. 

5.2),  as  well  as  a simple  but  interesting  result  on  processes  with  stationary 
increments  which  we  could  not  find  in  the  literature  (Lenma  5.5). 

The  second  useful  notion  in  the  study  of  the  nonlinear  space  of  a Wiener 
process  is  the  stochastic  integral.  The  stochastic  integral  was  first 
introduced  by  Ito  (1944)  for  the  Wiener  process  and  later  generalized  by  kieyer 
(1962)  for  rart ingales.  Every  functional  of  a Wiener  process  has  a 
representation  as  a stochastic  integral,  where  the  integrand  is  adapted  to  the 
Wiener  process. 

The  second  objective  of  this  work  is  to  define  a stochastic  integral  for 
general  Gaussian  processes,  and  this  is  done  in  Section  3.  The  general  pro- 
perties of  the  stochastic  integral  are  stated  in  Theorem  3.2  and  some  specific 
stochastic  integrals  are  calculated  (Theorems  3.5  and  3.7).  The  differential 
rule  of  the  stochastic  integral  will  be  developed  elsewhere.  The  stochastic 
integral  is  defined  for  general  integrands,  not  necessarily  adapted  or  nonant i- 
cipatory.  In  Section  4 it  is  shown  that  each  L^-funct ional  of  a general  Gaus- 
sian process  has  a representation  as  a stochastic  integral  where  the  integrand 
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is  adapted  to  the  Gaussian  process  (Theorem  4.2).  The  stochastic  integral 
of  nonanticipatory  integrands  is  also  considered  (Theorem  4.3),  hut 
the  L^-functionals  which  liave  nonanticipatory  stocliastic  integral  representa- 
tions have  not  been  characterized  yet. 

It  should  be  noted  that  the  two  representations  of  I^- functionals  of  a 
(general)  Gaussian  process  presented  here  (the  first  as  a series  of  multiple 
Wiener  integrals  and  the  second  as  a stochastic  integral)  open  the  way  to  the 
study  of  nonlinear  devices  with  (general)  Gaussian  inputs. 

Finally  a brief  summary  of  some  facts  on  tensor  products  of  Hilbert  spaces 
and  on  Hermite  polynomials  is  included  in  an  appendix  for  ease  of  reference. 
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1.  THE  HILBERT  SPACES  a?(R)  AND  X?(R) 

Throughout  this  section  T will  be  an  interval,  closed  or  open,  bounded 
or  unbounded,  and  X - (X^,  tcT)  a second  order  process  with  zero  mean  and 
covariance  function  R(t,s).  Integrals  over  T will  be  denoted  by  the 
integral  sign  with  no  subscript,  and  1E  will  denote  the  characteristic 
function  of  the  set  E. 

It  is  shown  in  Lodve  (1955,  p.  472)  that  the  following  two  integrals 

*t€f  S * { and  J(f)  « R J f(t)Xtdt 

can  be  defined  as  the  mean  square  limits  of  the  corresponding  sequences  of 
approximating  Rienann  sums  if  and  only  if  the  following  double  Rieraann 
integrals  exist, 

R JJ  f(t)f(s)d2R(t,s)  and  R Jj  f(t)f(s)R(t,s)dtds  , 

and  then  1(f)  and  J(f)  are  random  variables  with  means  zero  and  variances 
the  corresponding  double  Riemann  integrals. 

1.1.  The  Hilbert  Spaces  A,(R)  and  *2^) 

Consider  the  set  Sj  of  all  step  functions  on  T, 


f(t)  » fi  £n  !(a  ,b  ]W»  (ati'bn^  c T»  ***  de£ine 

f • f VV  ■ V • 
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e J f(t)dxt  * o 

E (f  f(t)dXt  « | g(t)dXt)  * ||  f(t)g(s)d2R(t,s) 

where  the  double  integral  is  defined  in  the  obvious  way.  Two  step  functions 
f,g  will  be  considered  identical  if 

||  (f(t)  - g(t))(f(s)  - g(s))d2R(t,s)  - 0 . 

If  we  define  for  f,g  e Sj  , 

<f,g>  - ||  f (t)f  (s)d2R(t,s) 

then  (Sj,  <«,«>)  is  an  inner  product  space.  Indeed  <f,g>  has  the  ordinary 
bilinear  and  syrmetric  properties,  <f,f>  * E (/  fdX)2  2 0,  and  <f,f>  ■ 0 
only  when  f is  the  zero  element  of  Sj  according  to  the  convention  intro- 
duced above. 

How  let  A2(R)  be  the  completion  of  Sj  , so  that  it  is  a Hilbert  space 
with  inner  product  denoted  again  by  <•,">•  A typical  element  in  A^R)  is  a 

Cauchy  sequence  of  step  functions.  However,  we  will  find  it  convenient  to 

treat  elements  in  A2(R)  as  "formal''  functions  in  t « T and  to  write 
2 

//  f (t)g(s)d  R(t,s)  for  the  inner  product  <f,g>  (see  Theorem  1 for  a partial 
* justification). 

Notice  that  for  f e Sj  the  integral  / f(t)dXt  depends  on  X only 
through  its  increments.  Thus  we  may  suppose  without  loss  of  generality  that 
there  is  a point  tQ  c T such  that 
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"0  a.e. 

z0 

Under  this  assumption  we  can  establish  an  isonorphisn  between  K(X)  and 
A2(R)  as  follows.  The  map 

3j  f H(X) : f I— | fdX 

preserves  inner  products  and  hence  it  can  be  extended  to  an  isomorphism  on 
A2(R)  to  a closed  subspace  of  H(X).  But  the  set 

\ * j lt(u)dXu  ’ 1 c T* 

where  lt  » 1^  t-j  for  t i tg  and  « -1^  t ] for  t < tp  , generates 
H(X)  and  lt  e Sj  . It  follows  that  the  isomorphism  is  onto  H(X),  i.e. 

A2(R)—  H(X). 

We  denote  this  isomorphism  by  I and  we  define  the  integral  of  f e A2(R) 
with  respect  to  X (which  we  write  as  / f(t)dXt  following  our  convention  to 
view  elements  of  A2(R)  as  formal  functions)  by 

j f(t)dXt  - 1(f). 

The  properties  of  this  integral  follow  from  those  of  I and  are  the  analogues 
of  the  properties  of  the  integral  when  X has  orthogonal  increments  (see  e.g. 
Doob  (1953)).  Tiie  integral  is  defined  for  ’’functions'1  in  A^R)  and  thus  it 
is  of  interest  to  identify  usual  functions  in  A2(R)  besides  the  step  func- 
tions. Two  such  classes  of  functions  are  identified  in  the  following. 
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Under  the  additional  assumption  that  R(t,s)  is  of  bounded  variation  on 

every  bounded  subset  of  T * T,  Cramer  (1951)  defined  A2(R)  as  the  completion 

(with  respect  to  the  same  inner  product)  of  the  set  S|  of  all  functions  f 

2 

whose  double  Riemann  integral  R //  f(t)f(s)d  R(t,s)  exists.  However,  Cramer’s 
definition  is  not  appropriate  for  the  general  case  (where  R is  not  necessarily 
of  bounded  variation  on  bounded  sets)  since  then  lt  may  not  be  in  A2(R)  and 
thus  A2(R)  nay  not  be  isomorphic  to  H(X).  In  this  sense  our  definition  of 
A2(R)  is  the  appropriate  generalization  of  the  definition  given  by  Cramer. 

That  S*  is  always  (even  when  R may  not  be  of  bounded  variation)  a sub- 
space of  A2(R)  and  that  for  f eS|,  1(f)  ■ R / fftJdX^  , follow  iimiediately  from 
the  fact  that  f eSf  is  equivalent  to  the  existence  of  R / f(t)dXt  and  the 
approximating  Riemann  suns  for  R / f(t)dXt  are  of  the  form  f fndX^  with 
f € Sj  . It  can  be  also  shown  that  when  R is  of  bounded  variation  on  bounded 
sets  then  the  two  definitions  of  A2(R)  coincide.  We  show  instead  the  following 
result  which  is  more  useful  for  our  purposes. 

R(t,s)  is  said  to  be  of  bounded  variation  on  [a,b]x[c,d]  if  for  all  N,M 
and  points  a ■ tQ<t^<. . .<t^  ■ b,  c - so<si<,,,<sm  = d the  sum 

&i  £4  ihvXh  R|  15  bounded’  '"here  ic^3),)  R ■ 

R(t,s')+R(t,s) . Also  R is  said  to  be  of  bounded  variation  on  every  finite 
domain  of  TxT  if  it  is  of  bounded  variation  on  every  [a,b]x[c,d]  c TxT.  Such 
an  R determines  uniquely  a o- finite  signed  measure  on  the  Borel  subsets  of  TxT, 
denoted  again  by  R,  such  that  R((t,t’]x(s,s'3)  * a£*  ^ R.  Let  Lj  be  the 

set  of  all  measurable  functions  f on  T such  that  the  following  Lcbesgue 
integrals  are  finite 
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||  |f(t)f(s)|d2|R|(t,s)  < » 

|f  1Ca,b](s)d"lRl(t-s)  ' ” 

for  all  (a,b]  c T,  where  |R|  is  the  total  variation  measure  of  R.  V/e  say 
that  the  function  f in  Lj  represents  an  element  in  A2(R)  if  there  is  a 
£'  c /^(R)  such  that  for  all  geSj  , 

<f',g>  * ||  f(t)g(s)d2R(t,s). 

IJotice  tliat  if  such  an  f ' exists  it  is  unique  since  Sj  is  dense  in  . 

He  will  then  denote  f'  by  f and  we  will  write  f e A2  (R) . With  this  conven- 
tion we  have  the  following 

THBORBi  1.1.  Let  R(t,s)  be  of  bounded  variation  on  every  finite  domain  of 
TxT.  Then  lj  ie  a dense  subset  of  A2(R).  Also  if  fpf2  € Lj  and 
If  |f1(t)f2(s)|d2|R(t,s)|  < « then 

<fr£2>  * ||  f1(t)f2(s)d2R(t,s). 

PROOF.  Let  E be  a bounded  Borel  subset  of  T.  Then  lg  c lj  and  we  will 
pTove  that  lg  e A2(R),  i.e.  there  is  an  f c A2(R)  such  that  for  all  gcSj  , 

<f,g>  - ||  lE(t)C(s)d2R(t,s). 

Let  I be  a finite  interval  containing  E (so  that  |R|(IxI)  < » ).  We  can 
always  find  IncI»  n ■ 1,2,...,  with  each  In  a finite  union  of  half  open 
intervals  such  tliat 

|R|  ((InAE)xl)  -*■  0 as  n-K». 
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| Since 

|R(lnxV-R(Wl  * |R|((InAE)yE)  ♦ |R|  ((ImAE)xE)  ->0, 

it  follows  tliat  <lj  ,1t  > R(HxE)  and  thus  {lj  }™=1  is  a Cauchy  sequence  in 

n An  An 

Define  f e A2(R)  by  f = lim  lj  . 

life  first  show  that  f does  not  depend  on  the  approximating  sequence.  Let 
I'  c I,  n = 1,2,...  be  another  such  approximating  sequence  and  f'  = lim  1T,  . 
Then  for  each  interval  Jcl  ue  have 

|<f-f',  lj>|  = lim  |<lj  -lj,,  lj>| 

n n 

= lim  |R(In*J)  - R(i;xJ)| 

s lim  {|R|((InAE)xj)  ♦ |R|((i;AE)xj)} 
s lim  {|R|((InAE)xl)  + |R[((I'AE)xj)}  = 0. 

If  Mj  is  the  closed  subspace  of  A2 (R)  generated  by  all  5]  * (a,b]cl , 
then  it  is  clear  from  the  above  that  f>f'  e Mj  and  f-f*  1 Mj  . It  follows 
that  f - f ' . 

I/e  now  sliow  that  f does  not  depend  on  the  finite  interval  I containing 
E.  Let  J and  Jn,  n * 1,2,...  have  the  same  properties  as  I and  In> 
n * 1.2 Define  I'  * I nJ  and  Ji,  = J nl,  n ■ 1,2,...  . Then  clearly 

In»Jn  c InJ  ^ lRl((InAE)x(InJ))  lRl  + 0 since 

(I^AE)x(InJ)  c (I^AE)xl , (J^AE)x(lnJ)  c (J^AE)xJ  and  |R|  is  a measure.  From 

the  result  of  the  previous  paragraph  applied  to  I,J  and  InJ  we  have 

lim  1,  = lim  1TI  * lim  1T,  **  lim  1T 
*n  Jn  Jn 


A 
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and  thus  f does  not  depend  on  I. 

Hence  f is  well-defined.  Now  fix  J = (a,b]  c T and  let  I be  a finite 
interval  containing  EuJ  and  In  , n = 1,2,...,  as  before,  i.e.  lj  -*•  f.  Then 

|<f,lj>  - R(E*J) | = lim  |R(InxJ)  - R(ExJ)| 
s lim  |R|((InAE)xl)  = 0. 

hence  <f,lj>  = R(ExJ)  and  since  J is  arbitrary  it  follows  that  for  all  geSj  s 
<f.g>  = //  lr(t)g(s)d2R(t,s).  Thus  we  have  shown  that  lp  e A2(R). 

ltow  if  E and  F are  bounded  Sorel  subsets  of  T,  denoting  by  lp  and  lp 
also  the  corresponding  elements  in  A2(R)  we  have  <lE,lp>  *=  R(ExF).  Indeed  if 
I is  a finite  interval  containing  EuF  and  as  before  lj  -*■  lp  and  lj  -*■  lp 
we  liave  (since  R is  symmetric) 

iRdn^,)  ' RCExF)  | s |RKlnx(JmAF))  + |R|  (dnAE)xF) 

s |R|((JnAF)xl)  + |R|((InAE)xl)  -v  0 

and  thus  <1-, ,lp>  = lim  RdnxJra)  = R(ExF). 

It  then  follows  that  if  <{>  is  a simple  function  in  Lj  with  bounded  support 
then  $ c A2(R),  and  if  <j>p<}>2  are  tv,°  such  functions  then 

<4>]_ » d>2>  * ||  ♦1(t)4»2(s)d2R(t,s). 

How  let  feLj  . Then  there  exist  simple  functions  <Pn>  n a 1,2,...  , with 
bomded  support  such  that  1 4>n|  + |f|  on  T.  It  follows  from  the  Bounded  Conver- 
gence Theorem  that 


| <t»n(t)^(s)d2R(t,s)  - ||  f(t)f(s)d2R(t,s). 
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Hence  <f>n,  n * 1,2 is  a Cauchy  sequence  in  A2(R)  and  we  denote  its  limit 

by  f'.  Then  for  all  geSj 

<£' ,g>  = lira  «|)nfg>  * lin  ||  <f>n(t)g(s)d2R(t,s) 

- ||  £(t)g(s)d2R(t,s) 

again  by  the  Bounded  Convergence  Theorem  since  feLj  and  geSj  imply 
//  |f(t)g(s) |d  |R| (t,s)  < °°.  Since  the  values  of  <£’ ,g>  for  geSj  determine 
f'  uniquely,  the  last  equality  implies  that  f'  is  uniquely  determined  by  f, 
independently  of  the  approximating  sequence  ^ . It  follows  that  f e A2(R)  and 
tints  L j c A2(R).  Since  L j contains  Sj  it  is  dense  in  A2(R). 

For  the  last  statement  of  the  theorem,  with  the  obvious  notation,  we  have 

<frf2>  = lim  «t>ljn^2>n>  = lim  ||  «1>R(t)^2>n(s)d2R(t,s) 

= ||  f1(t)f2(s)d2R(t,s) 

where  the  additional  assumption  on  fpf2  makes  the  Bounded  Convergence  Theorem 
applicable.  □ 

Consider  now  the  set  Sj  of  all  functions  f on  T such  that  the  Riemann 
integral  R ff  f(t)f(s)R(t,s)dtds  exists  and  is  finite.  Sj  is  a linear  space. 
Two  functions  f and  g in  Sj  will  be  considered  identical  if 

R ||  (f(t)-g(t)) (f(s)-g(s))R(t,s)dtds  * 0. 

For  f,g  £ Sj  we  define  / fCtJX^dt  » R / f(t)X^dt  and  then  we  have 

E(|  • | gft^dt)  * R ||  f(t)g(s)R(t,s)dtds. 
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Define  for  f,g  c Sj  , 

<f,g>  - R ||  f(t)g(s)R(t,s)dtds. 


Then  (Sj,  <•,»>)  becomes  an  inner  product  space.  X£ C^-)  is  defined  to  be  the 
couplet ion  of  the  inner  product  space  Sj  and  so  it  is  a Hilbert  space.  Again  a 
typical  element  in  X2(R)  is  a sequence  of  functions  convergent  in  norm.  How- 
ever formally  we  shall  treat  elements  in  X2(R)  as  factions  and  write 
ff  f(t)g(s)R(t,s)dtds  as  the  inner  product  <f,g>. 

In  order  to  establish  an  isomorphism  between  H(X)  and  X2(R)  we  shall 
assume  that  X is  mean  square  continuous  which  is  equivalent  to  the  continuity 
of  the  covariance  function  R(t,s).  Consider  the  sequence  of  functions 

n • 1 , (t)  where  t is  an  interior  point  of  T.  It  is  easy  to  show  that 

CT-i.T] 

tliis  sequence  is  a Cauchy  sequence  in  X2(R),  whose  limit  is  denoted  by  6t  , and 


that 


Then,  the  nap 


XT  ■ l.i.m.  | n • 1 ^ ^(t)Xtdt  . 


n’ 


Sj  H(X)  : f |—  | f(t)Xtdt 


preserves  inner  products  and  its  range  includes  XT  for  all  interior  t of  T 
(which  is  linearly  dense  in  H(X)  by  mean  square  continuity) . Hence  it  can  be 
extended  to  an  isomorphism  on  X2(R)  onto  H(X) . Thus  X2(R)  ~ H(X) , the  iso- 
morphism is  denoted  by  J and  for  f c X->(R)  we  define 


| f(t)Xtdt  =■  J(f). 


I 


4 

i 
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A useful  connection  between  the  integrals  I and  J and  the  spaces  A2 
and  X2  can  established  as  follows.  Let  Zt  = X^u  » J(l^  t]^  whcro 
tg  is  an  arbitrary  but  fixed  point  in  T.  ( l(t  t]  6 *2^  since  R is  con- 
tinuous.) Then 


r(t,s)  = E z. 


R(u,v)dudv. 


THEORBi  1.2.  If  X is  mean  square  continuous  then  X2(R)  a ^(F)  for 

all  f e X2(R)  - A2(T), 

| f(t)Xtdt  * | f(t)dZt  . 

Hence  H(X)  =*  H(Z). 


PROOF.  We  first  prove  that  the  existence  of  R fj  f(t)f(s)R(t,s)dtds  is 
equivalent  to  that  of  R /T  /T  f(t)f(s)d2r(t,s) . We  nay  assume  that  T is  a 
closed  interval  by  the  very  definition  of  a Rienann  integral.  We  also  assume  that 
| f (t)  | < M for  all  teT;  otherwise  neither  Riemann  integral  will  exist.  Consider 
the  typical  Riemann  suns 

Rj  - IX  fCtpfCs^RCt.^)  |A.|  |B.| 

- ll  £(ti)f(Sj)r(AixBj) 

where  {A^>,  {B^ } are  interval  partitions  of  T,  t^eA^,  sjcBj?  aru*  l\l*  lBj  I 
denote  the  lengths  of  these  intervals.  By  the  uniform  continuity  of  R(t,s)  we 
have  that  for  every  e>0,  |Rj*Rjl  s |T| as  nax(|A^|  ,|B^|)  -*■  0.  We  thus 
conclude  tliat 


1 

jL 
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R ||  f(t)f(s)R(t,s)dtds  - R ||  f(t)f(s)d2r(t,s) 
and  the  existence  of  one  integral  implies  that  of  the  other.  In  short, 

(SI’  <°'*>A2(r)^  " (SJ’  <0»“>x2(r))* 

ifote  that  S*  is  dense  in  (r)  (since  r is  continuous)  and  Sj  is  dense  in 
A2(R).  Thus  X2(R)  - A2(T). 

For  a step  function  f we  clearly  have  / f(t)Xtdt  » / f(t)dZt  ; hence  this 
is  true  for  all  f e A2(r)  by  the  continuity  of  I and  J.  □ 

A2(R)  may  contain  interesting  classes  of  functions  larger  than  Sj  . Let 
Lj  be  the  set  of  all  measurable  functions  f on  T such  that  the  following 
Lebesgue  integrals  are  finite 

I | |£(t)f(s)R(t,s)|dtds  < ® 

||  |f(t)|  l(a>b](s)  |R(t,s)|dtds  < • 

for  all  (a,b]  c T.  We  will  follow  the  same  convention  (as  for  A2  ) in  treating 
functions  f in  Lj  as  elements  of  A2(R)  if  there  is  a {'  e A2(R)  such  that 
for  all  g in  a dense  subset  of  A2(R), 

<f 1 »S>  * ||  f (t)g(s)R(t,s)dtds. 

With  this  convention  the  following  is  a corollary  of  Theorems  1.1  and  1.2. 

CPROLLARY  1.3.  Let  R(t,s)  be  continuous  on  TxT.  Then  Lj  ie  a dense 
subset  of  A2(R).  Also  if  fp f2  « Lj  cmd  ff  |f^(t)f2(s)P,(t,s)  |dtds  < »,  then 


r 
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We  now  remark  on  the  relation  between  A2,A2  sPaces  ^2  sPaces*  T*ie 
spaces  A2(R)  and  A2(R)  are  generalizations  of  L2  spaces.  In  general  they  are 
larger  than  L2  spaces.  As  an  example , consider  R(t,s)  a continuous  covariance 
function  on  [a,b]*[a,b]  and  let  r(t,s)  be  defined  as  before.  Then  A2(R)  * 

A2 (T) . livery  function  f in  L2([a,b],dt)  belongs  to  A2(R)  " A2(T)  by 
Corollary  3 since 

||  |f(t)f(s)R(t,s)|dtds  s max  |R(t,s)|  • (|  |f(t)|dt)2 

s max  |R(t,s)|  » |b-a|  | f2(t)dt  < ® 

and  similarly  ff  |f(t)|l^a  ^-jCs)  |R(t,s)  |dtds  < ®.  However,  6t  e A2(R)  “ A2(T) 

is  not  in  L2([a,b],dt)  since  Xj.  * J(6t)  for  all  interior  points  t of  T 

implies  R(t,s)  * //  6tCu)5s(v)R(u,v)dudv. 

Nevertheless,  there  is  a special  case  where  A2(R)  reduces  to  an  L2  space. 

Let  X be  a zero  mean  process  with  orthogonal  increments.  Assume  X*.  =0  a.e. 

0 

for  saie  fixed  tgeT.  Then,  R(t,s)  ■ F(tgV(tAs))  + F(tgA(tvs))  where  F(t)  ■ 

2 2 

E\*  if  t i tg  and  « -EX£  if  t s tg  . F is  nondecreasing  and  thus  R(t,s) 
is  of  bounded  variation  on  every  finite  domain  of  T*T,  and  the  associated  measure 
concentrates  on  the  diagonal  t*=s  of  TxT.  In  this  case  A2(R)  * L2(T, 

In  particular,  if  X is  the  Wiener  process  A2 (PO  ■ L2(T,dt).  A slightly  weaker 
result  is  easily  seen  to  be  valid  when  R(t,s)  = fQ  /Q  lc(u,v)dudv  + tAs,  with 
k c L?(T*T);  in  this  case  the  two  sets  (rather  than  spaces)  are  equal,  A2(R)  ■ 
L2(T,dt),  and  their  norms  are  equivalent.  In  fact  we  have  the  following  more 
general  result. 


"rf  i,mr  - 'oAigii* 
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THEOREM  1.4.  If  R and  S are  two  equivalent  covariance  functions  (i.e. 
the  associated  zero  mean  Gaussian  measures  are  equivalent)  then  the  following  sets 
are  equal,  A2(R)  * A2(S)  and  *2(R)  " an ^ their>  normB  are  equivalent. 

PROOF.  Denote  by  yR  and  yg  the  zero  mean  Gaussian  measures  with  co- 
variances  R and  S on  BCR1),  and  by  X - {Xt,  t«T}  the  coordinate  process  on 
RT  . An  element  in  A2(R)  is  really  an  equivalence  class  of  sequences  <f>n  e Sj 
such  that  I is  a Cauchy  sequence  in  f-2(dyR)  with  a common  limit,  and  such 

an  element  is  denoted  by  <$>n>. 

Suppose  that  <<j>n>  c A2(R)  and  that  yR  = yg  , i.e.,  yR  and  yg  are 
equivalent.  We  show  <<t>n>  e A2(S).  First  observe  that  <<J>n>  = <4>ni>  f°r 
subsequences  {n1}  of  {n}.  Thus  we  may  assure  that  / <}>ndX  is  Cauchy  both  in 
L2(yR)  and  a.e.  [yR].  It  follows  from  yR  = yg  that  / ^dX  is  also  Cauchy 
a.e.  [yg]  and  hence  it  is  Cauchy  in  L2(dyg),  since  each  / 4>ndX  is  a Gaussian 
r.v.  This  implies  that  «*>n>  c A2(S).  So  A2(R)  c A2(S),  and  the  assertion  now 
follows  fron  symetry.  The  case  of  X2  spaces  is  shown  similarly.  □ 

It  should  be  remarked  that  the  converse  of  Theorem  1.4  does  not  hold.  For 
exanple,  A2(R)  » A2(aR)  as  sets  and  their  norms  are  equivalent  but  R and  oR 
are  not  equivalent  (a*l) . 

1.2.  Tensor  Products  of  A^R)  and  X2(R) 

We  now  study  the  tensor  product  spaces  A2 (R)  and  •*5X2(R).  Consider  the 
set  of  all  step  functions  f(tjP...,tp)  on  Tp  . Define  the  following 

function  on  Sjp^*S^  , 
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<f''r>  3 II  ”*  II  £(ti’ * • • ' Ve(sl sp)d2R(t!  .si)  • • .d2R(tp,sp)  , 

and  identify  f with  " if  <f-£,f-g>  = 0.  Let  lj  x xJ  , lj  x xJ  c 

1 *•*  p 1 •••  p 

(x.e.,  1^,  J.  are  bounded  half  open  intervals  in  7 ).  Then 

> ■ |j  h Wlj  (s)A.(t,s)  ...  fj  1,  (t)lj  (3)d2F.Ct,s) 

i*  ^ P A i.  P P 

= <1ii,1ji>^2^)  •”  <1i?,1J?>a2(P0 

= <1T  ®. . .®1T  , 1-  ®. . .®1T  > 

1 p J1  Jp  ® A2(P.)  • 

This  implies  that  <•»•>)  is  an  inner  product  space  and  we  shall  denote 

by  (®-\)  the  coroletior.  of  . Since  {1T  ®...®1T  } is  a coi.plete  set 

1 P 

m ® A-,  (P.) » we  have 

A2(®?R)  s ®?A2(h)  . 

X2  (®-  a)  can  be  defined  in  a simlar  manner.  Let  sj^  be  the  set  of 
functions  of  the  fom 

*(*]»•••  lO  - l dHetn)  ...  ^ (t  ) 

where  the  4>’s  belong  to  Sj  . sj'^  is  a linear  space,  define  on  Sj^xSj^ 
the  function 

<f,2>  G R ft  “•  If  f(^15---»tp)f(s1,...,s,.p?.(t1}s1)  ...  R(tp,si>)dt1us1  ...  dtpd 

and  identify  f with  z i£  <f-g,£-g>  = 0.  With  the  observation  that  for 
*i»*j  c 5J  » 
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*^1^1^  • • Ctip) > 

* R ||  4>i  (t)  ^ (s)  R(t , s) dtds  ...  R ||  <J)p(t)'{'p(s)R(t>s)dtds 

" <<i)i»^i>x2CR)  •*•  <^p'^p>x2(R) 

" <<}>•]••  • •®4>r)>  ita*. ..•{>  > , 

1 ? 1 P ® A2(R) 

and  with  the  fact  that  . .®<xJ  is  a complete  set  in  ®PA2(R) , we  conclude 

that  (s£» , <«,’>)  is  an  inner  product  space  and  that  its  corral et ion,  which  is 
denoted  by  A2(«PR),  is  isomorphic  to  ®PA2(R) . 

As  in  the  case  of  the  spaces  A2(R)  and  A2(R)  we  will  treat  elements  of 
A2(®PR)  and  A 2 C®PR)  as  "formal"  functions  and  we  will  write  the  inner  products 
in  a formal  integral  form.  As  before,  under  some  conditions,  elements  of  A2(®Pr) 
and  A2(»pR)  will  be  representable  by  functions  on  T11  in  the  corresponding 
sense  and  in  this  case  we  will  identify  the  elements  of  A2  and  X2  with  the 
functions  (see  Theorem  1.5  and  Corollary  1.7).  The  important  point  here  is  that 
we  have  identified  the  abstract  tensor  product  spaces  ®PA2(R)  and  ®pA2(R)  with 
the  (nearly)  function  spaces  A2(«PR)  and  A2(®PR).  From  now  on  we  will  malce  no 
distinction  between  •PA2(R)  and  A2 (®Pr) , and  between  ®PA2(R)  ~nd  A2(*Pr). 

Let  R be  of  bounded  variation  on  every  finite  domain  of  T*T  and  let  LjP^ 
be  the  set  of  all  measurable  functions  f on  Tp  such  that  the  following 
Lebesguc  integrals  are  finite 

• |J| ^(^1  * • • • »^p)^(sl» • * • >sp) |d  | R| (tj ,Sj) . . .d  |R| (tp»sp)  < 00 
|J*  - * JJi  1 1i^x. . . xlp^sl»  • * * *sp^^  I Rl  C^i  *si)  • • .d  |R|(tp,Sp)  <«> 

for  all  bounded  half  open  intervals  Ip..., Ip  c T.  The  following  theorem  can  be 
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proven  like  Theorem  l.i  and  thus  its  proof  is  omitted. 

THEOREM  1.5.  Let  P-(t,s)  be  of  bounded  vazdation  on  every  finite  domain  of 
T*T.  Then  LjP^  is  a dense  subset  of  A2 C*^)  • Also  if  fpf7  c and 

//...//  |R|  |^|(tp,sp)  < then 

<^1*^2>  * i/* * * 11^1  C^l*  * * * ^2^1  ’ " * " * ^p^Q  R(t^*Sj)...d  R(tp,sp)  • 


Theorem  1.5  may  be  used  to  derive  the  well  known  fact  that 
L2(Tp,dtP)  - •PL2(T,dt). 


THEORSi  1.6,  If  R(tjS)  is  continuous  on  T*T,  then  A^e^R)  = A2 (*^T ) . 

PROOF.  This  follows  immediately  from  the  facts  that  the  set 
{^•...•4>n,  <fweSj}  is  complete  in  both  A2(*^R)  and  A2(»Pr)»  and  that  the  two 
inner  products  are  identical  on  this  set.  □ 

Let  be  the  set  of  all  measurable  functions  f on  Tp  such  that  the 

following  Lebesgue  integrals  are  finite 

JMH s )f  (Sj sp)R(t1,s1) . . .R(tpSsp)  IdtjdSj. . .dtpdsp<oo 

/l’*’l|lf^tl,,'*’tP^l1Il,<***xIT)^Sl,,*',Sp)lR^tl,Sl^"‘R^tP,SP^ldtl<iSl,,dtpdSP 


<« 


for  all  bounded  half  open  intervals  I1# . . . ,Ip  c T.  With  the  usual  corresponding 
convention  the  following  is  a corollary  of  Theorems  1.5  and  1.6. 

OOROLLAPY  1.7.  Let  P»(t,s)  be  continuous  on  T*T.  Then  Ljp^  is  a dense 
subset  of  A2(*PR).  Also  if  f^,f2  and  //. . .//| fj(t^, . . . ,tp)f2(Sp. . . ,sp) 

R(t1,s1) . . .R(tp,sp)  | dtjdSj . . • dtpdsp«*>j  then 
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(tj * • • • » tp) ^2^sl’  ’ ’ * * sp)*^i » ®j) • • • R(^p»Sp)dt^ds^ . . .dtpds,. 


Finally  let  us  consider  the  symetric  tensor  products  3^ (R)  and  «*>X2 (R) . 
For  f e A, (®?R)  define  ?(t,,...,t  ) ■ (o!)"1  7 f(t  , ...,t_  ) where  the  sum  is 

7T  I p 

over  all  permutations  tt  = (tt1 trp)  of  (l,...,p),  and  ? is  called  the 

symmetric  version  of  f.  7 is  well-defined  since  f is  a 'function'*.  Indeed, 

7 is  first  defined  for  f e , and  then,  using  the  easily  verified  fact  that 

| |r||“  s p!  | |f| | , the  definition  is  extended  by  continuity  to 

A2(«pR)  A2(®i>R) 

A2 CS^R) . If  f=f  then  f is  said  to  be  a symmetric  "function*'.  Let  A2 (®^R) 
be  the  subspace  of  all  symmetric  "functions"  in  A2 (®^R) . Then  it  is  easy  to 
show  that  A2  (S^R)  is  a Hilbert  space  and  a^^CR)  ~ A2  (®^R)  under  the  corres- 
pondence f-j®. . •*fp  (fiCti)***fpCtp))  . Sii:dlariy,  let  X2  be  the 

subspace  of  all  symmetric  "functions"  in  • Then  v/e  can  show  that 

•^(R)  ~ X 2 (under  the  natural  correspondence).  As  before,  we  shall  hereon 
identify  ®?A2(R)  with  A^CS^R),  and  eJ5A2(R)  with  A2(8^R). 


1.3.  Fourier  Transform  on  A2^R)  and  A2(®^R) 

Consider  the  covariance  function  R(t,s)  of  a zero  mean,  mean  square 
continuous  process  A = (X^.,  -oo<t<co}  with  (wide  sense)  stationary  increments. 
For  convenience  such  R is  said  to  have  stationary  increments.  Let 

(1.1)  R(t1,s1;  t2,s2)  - E(Xt  -Xs  -Xs  ) . 

11  2 2 

Tlien  it  is  well  known  (Doob  (1953),  p.  552)  that  R(tpSp  t2,s2^ 
have  the  following  spectral  representation 
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it.X  is,X  -it7X  *is7X  . .2 

(1.2)  RfCi.s,;  t2,s2)  = (e  - e " ) (e  - e z cIF(X) 

J -00  X 

(1.3)  x*  ' xs  = f_  (eltX  ' elSX)  ^ dvx 

where  dF(X)  is  a finite  measure  on  G(R)  and  V = (V^,  -<»<x<<»}  is  a process 

2 

with  orthogonal  increments  and  E | dV^ | = dF(X).  We  remark  that 

(1.4)  H(AX)  = H(AV) 


where  AX  denotes  the  set  of  increnents  of  tne  process  X. 

Define  the  Fourier  transform  of  f e by 

if®  r i(t1X1+...+t  X ) 

£(Xi....,\p)  - j ...  J e 15  P f (tj » . . . »tp)dt1. . .dt^  . 


The  program  is  to  define  the  Fourier  transform  f of  every  f in  A2(**5R). 

(For  this  reason,  it  is  convenient  to  extend  A2 (®*Vo  from  a real  Hilbert  space 

A ID  13 

to  a complex  Hilbert  space.)  From  (1.2)  it  follows  easily  that  f e L2(R*  , y) , 

for  f e , where  the  measure  y is  defined  by  dy(X)  * (l+X^)dF(X),  and 

<f,g>  - <f,g>  _ n • Since  the  nap  F : ■+  L?(RP,  yP)  : f I— ► f 

A2(*PR)  L2(Rp,yp)  1 

is  linear  and  preserves  inner  products,  it  can  be  extended  to  an  isomorphism  on 

A2(*Pk) . We  now  show  that  F if  onto  L2(Rp,yp).  It  is  sufficient  to  show  that 

A A A 

1(a1,b1]>‘...x(at),bp](XP*“»V  * 1(a1,b1](xl)  *"  1(ap,bp](Xp) 

form  a complete  set  in  L2(Rp,yp);  or  equivalently  that 

~ ibX  iaX 


form  a complete  set  in  L2(R,y).  Since  L0(R,dF)  ~ H(AV)  under  the  correspondence 
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A. 


2 % 

h + — ► / hdV,  it  follows  from  (1.3)  and  (1.4)  that  {(e^-eis*)  ^ s<t) 

A 

is  corplete  in  L2(R„dF),  and  hence  (1^  a<b)  is  complete  in  L2(R,y).  We 
thus  have  the  following 

THsQREd  1.3.  The  map  F:  Sjp^  -*■  L2(RP,yp):  f I — *■  f has  a unique  extension 
to  an  isomorphism  from  A2  (®*5R)  onto  L2(RP,yP). 


The  extended  rap  is  again  denoted  by  F and  is  called  the  Fourier  transform 
on  (®^T) . We  also  write  f for  F(f). 

If  we  let  X be  the  Wiener  process,  i.e.,  R(t,s)  = tAs,  then  A2(»PR)  = 
L2(RP,dtP) , dy(X)  = -jjj- dX.  Therefore  F reduces  to  the  ordinary  Fourier  trans- 
form on  L0(Rp,dtp) . 

Suppose  now  that  R(t,s)  is  stationary  (which  implies  that  R has  station- 
ary increments) . Then  by  Bodmer's  theorem  we  have 


R(t,s) 


' e^ 


l-s)X 


dv(X) 


with  v a finite  measure  on  8(R).  It  is  plain  to  deduce  from  (1.2)  and  (1.5) 
that 

1 


dv(X) 


-y  dy(X) 


on 


Thus  A. (•pR)  ~ L2 [rP , dp  (X2v (X) ) j . Mow  we  define  the  Fourier  transform 
X2(»pR).  Let  r(t,s)  = /q  R(u,v)dudv.  Then  the  covariance  T has  stationary 
increments  and  A2(«pr)  * X^f®^?.).  The  Fourier  transform  on  X2  (®PR)  is  defined 
to  be  the  Fourier  transform  F on  A2(®pr).  It  is  a simple  matter  to  verify  that 
the  spectral  measure  of  T is  (1+X2)  *dv(X)  and  thus  X2(®PR)  ~ L2(RP»vP). 
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THEORli  i 1.9.  if  R(l , s)  v 3 a continuous  ntu.t lonary  covariance  function . 
then  L1  rsS)  is  a dense  cubspace  Oj  (®^P0  • and  F restricted  to  L-  (Lr ) xt, 
the  ordinary  Fourier  transforrr. 

PTOOF^  Let  f <•  L3  (,-p) . Then 

II"  ”f  ^ ’ ’ ’ ,r'p-'^sl* ' ’ * '3n^^l,sl^  * ' ' P^p>sp')  I^L^CiS^-  • .dtpdsp 


* v(rop| ! £| 


U (Rp) 


< co 


7 ? 

since  |R(t,s)j  < X(t»t)R(c,s)  = v(i\) ' . Similarly,  the  second  condition  in  tne 
definition  cf  L ^ is  verified.  Thus  f e A2(*PR)  by  Corollary  1.7.  Since 
c L,  (2P)  is  dense  in  = A2(»PR),  it  follows  that  Ln  (Rp)  i<=  dense 

in  A2  («pR) . 

To  prove  the  second  assertion  it  is  sufficient  to  prove  that  for  f e L-,  (?:•"*) 

the  ordinary  Fourier  transform  f belongs  to  L7(le,.vr)  and  [ | f 1 1 = 

' L^(np,vP) 

|jf||  . | f I s | | f ||  implies  f c L9(Rp,vp) . We  have  from  Corollar- 

A2(®pP.)  Lj  (Rn)  Z 

1.7  that  ||f|r  = )T(sr,T7^rni(t1,s1)...R(tn ,s  ) 

a2>  ;)  1 ? 1 ? 11  pp 

dtjds1 . . .dt^dSp  . Substituting  R arid  interchanging  the  order  of  integration 

by  ^u’o ini's  theorem,  we  obtain  ||f||  ..  = ||f||  . The  proof  is  now 

A (^R)  L2(R*V) 

complete.  □ 


Let  R be  again  a covariance  function  leaving  stationary  increments  and  let 

f c A2 (•PR1 • V'e  define  the  translation  fT  of  f by  t = (T^,...,ip)  as 

foliows.  Pick  a sequence  of  step  functions  <pn  such  the*  lhn  <J>n  = f in 

A7(®‘P.\  The  translation  of  each  <j>  is  defined  by  <J>  (t,,....t  ) = 

+Tj.  Clearly  ||*  |i2  - s!l<i>J|2  ,,  • This  implies 

* 1 p T?n  A-^R)  n A2(#-F.) 
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that  {>*>T  / a Cauchy  sequence  in  A2(»Pp),  and  f is  defined  to  be 
lin  ^xn  . A sinple  argument  shows  that  the  definition  of  f does  not  depend 
or.  the  choice  of  the  approximating  sequence  (<i>n>  and  f becomes  the  usual 
translation  if  f is  indeed  a function. 

Tnen  R is  stationary,  the  translation  fT  of  £ c X2(®Pr)  can  be  defined 
similarly  (or  via  the  identity  X^C^R)  = A-Ofy)  ). 


then 


vL  ■ 1.10.  If  R is  a continuous  covariance  with  stationary  increments , 
A2(VR)  is  invariant  under  translations , and  for  f,g  e A^epR)  we  have 


and 


<f  ,r  > 

t * 


T 0 


<f , c > 

T‘°  a2(A) 


A " i T«»  T ) /v 

fr^i Ap)  =•  e ?P  f(Xp. 


PROOF . Since  R lias  stationary  increments,  all  these  assertions  hold  for 
f c Sj!^  . Hence  they  hold  for  all  f e A2(®PR)  by  continuity  (cf.  Theorem  1.8) 

Ice  corresponding  theorem  for  translations  on  X2(®PR)  also  holds. 
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2.  MULTIPLE  '.'IE:0  IdTCPSALS 

Suppose  X ■ (3L,  tcT),  T an  interval,  is  a zero  mean  Gaussian  process 
with  covariance  function  R(t,s).  !'/e  shall  define  the  multiple  Wiener  integrals 

GW’s)  of  the  following  two  types: 


where  p =•  1,2,...  . We  will  assume 

(I):  * 0 a.s.  for  some  tn  e T, 

while  dealing  with  integrals  Ip  ; and  while  dealing  with  integrals  J , 

(J):  X is  mean  square  continuous. 

The  FWI  Ip  has  been  defined  for  X a Wiener  process  in  ltd  (1951)  and 
Wiener  (1953);  in  this  case  f is  taken  to  be  a function  in  L2  (T^ , dt^)  and 
(p!)  **Ip  is  an  isomorphism  on  L2  (T*3 , dt*5)  (the  Hilbert  space  of  all  symmetric 
functions  in  L2(T^,  dtp)  ) into  L2(X).  The  major  step  in  generalizing  the 
notion  of  the  ■ HI  1^  to  a Gaussian  process  other  than  the  ’Wiener  process  is  to 
determine  a proper  Hilbert  space  of  functions  on  which  Ip  will  be  defined. 

Clearly  I ^ s’tould  be  defined  as  the  isomorphism  I from  A2(R)  onto 
K(X).  Now  for  p > 1,  in  accordance  with  the  Wiener  process  case,  it  is  reason- 
able to  expect  that  functions  f(tj,...,tp)  of  the  form  ^(tj)  ...  <t»p(tp)> 

♦j  e A2(R),  are  admissible  integrands,  and  their  integral  Ip(f)  is  the  iterated 
integral  1(4^)  ...  I (4>p)  when  are  orthogonal.  This  suggests  that 


r 
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the  Hilbert  snace  A7(^R)  is  the  proper  class  of  integrands  for  the  ! ifl  I . 

L P 

Similarly  the  Hilbert  space  A-^e^P.)  is  the  proper  class  of  integrands  for  the 
INI  J . Once  the  classes  of  integrands  are  determined,  iWI's  can  be  defined  in 

r 

a straightforward  manner. 

We  will  use  the  following  result  on  the  structure  of  the  nonlinear  space  of 
a Gaussian  process  X (see  Neveu  (1368),  Kallianpur  (1970)  ). 

Let  X be  a zero  mean  Gauacian  process.  Then  there  exists  a unique  iso - 
morphism  * fron  • q! H*^(X)  (where  the  space  for  p=0  is  the  set  of  all  con- 
stant r.v.  's  in  L2(X)  ) onto  L2(X)  such  that 


He*h  =e^ll5ll‘ 


where  e®'’  * ip>g(p!)  ‘5®^  , ( e H(X).  If  c H(X)  are  orthogonal  then 


«(^Pli. . .i^k)  - (p!)’^i 


(50  ...  H 


,2«1 


,2(5]P 


Ppiiqir  x pk,iiskir 

where  p 3 Pj+...+Pjc  . If  (^  , yeD  ( T linearly  ordered ) is  a COiJS  in  H(X) 
then  the  family 

®I> 


c y 2ay ) ...  (py  ir^i  2ay ) , 

Yl  " "r  Y1  Yk  .lie  I r Yk 


h Yi 


V 


p*0,  tel,  pY  +...+PY  “ p,  Y1<***<Y*k  , is  a CONS  in  L2(X), 

We  now  define  Ip  , p*l.  Since  A2(rt)  is  isonorphic  to  H(X)  under  the 
isomorphism  I:  f | —*■  f fdX,  A2(5?R)  3 •PA2(R)  is  isomorphic  to  H^fX). 

Denote  this  isomorphism  by  I*P  . For  4^,. . . orthogonal  in  A2(R)  we  have 


f 
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C*«I*P)  (^J. . .5*p)  =»  4>(|<j>1d>:®. . . S J 4>p<2X) 

= (PO "?S  l^jdX  ...  J<*>pdX, 

which  suggests  the  following  definition  of  I : A?  (®pR)  •+■  L7(X)  (in  fact  onto 

"P  C,  L 

Ip  - (p!)5*  4-0 1®-3  . 

Furthermore  v/e  define  Ip(f)  = Ip(?)  for  f c A2(®^R),  where  ? is  the  synnetric 
tensor  of  f (i.e.,  the  projection  of  f onto  the  subspace  of  synnetric  ten- 
sors). Tie  following  results  are  then  immediate  consequences  of  the  fact  that 
I*P  is  an  isomorphism. 


T£03E'!  2.1.  Let  X be  a zero  mean  Gaussian  process  satisfying  (I).  Then 
the  ill's  Ip  , psl,  have  the  following  properties  (f,g  e A£ 

Ip(af+bg)  » alp(f)  + blp(g)  , a,b  e R, 

*p(f)  = h®  * 

<ip (f ) , ip (c) >l2 (x)  - Pi<*i>  ^ > 

<Ip(«,Iq(g)>L2(x)  - 0 if  p*q  , 

*H  2(kd:<)  ••• H 2(kdx) » 

Pl  “ J P1,ii<f>1ir  1 1 pk,n$kir 

where  (<t>2> . • . >4>k}  w an  orthogonal  set  in  A2(R)  and  Pj  + ***+I\  “ p.  Also 
every  L^- functional  0 of  X,  0 c L^CX),  has  an  orthogonal  development 

0 - E(0)  ♦ l I (f  ) , f £ A2(«PR)  , 
p*l  P P P L 

and  if  9 - E(0)  - IpaIp(fp)  » Ip2lIp(3p)  then  ?p  - Sp  , P*l. 


in  exactly  the  scu,.e  way  v~  c«*n  define  J^(lj  ■01  i e x2C°l,»),  and  (y 1 ) 
iestrictea  to  A2(5?R)  is  an  isonorphisri  onto  . Hie  coriesponding 

Theorem  2.1  also  holds  for  the  ilfl's  J„  , oil. 

P 

It  should  be  noted  that  the  M's  I_(f)  “ . ./f(t. . ,t  )d)h  ..chC  and 

? J p Tp 

J (f)  = /.  ../f(t, t )>L  . . - Xt  dt, ...dt  are  defined  in  the  mean  square  sense 

? £ P ^ cp  P 

and  it  is  thus  of  interest  to  see  whetlier  they  can  be  evaluated  from  the  saryle 
paths  of.  X.  This  can  be  done  as  follows  when  X is  mean  square  continuous.  Lee 
>i=l  he  a raN[S  H(X),  and  write  * /<^(t)dXt  where  <J>i  c A2(R) . Then 
^i^i-1  2 in  A7(R) - Since  clearly  B'fX)  * 3(5^  n»l,2,..)t  by  the 

T) 

martingale  convergence  theorem  we  have  for  each  f e A2(©*R)  that 


I (£)  = lim  f (l  (t;/C^s • • • »^n)  &-S. 

p rrH»  i 


'h  also  have 


and  thus 


f-  l <f,  ><p. 

ix 1^*1  h S H \ 

= 7.  .a.  . A.  •.  ..«<{>. 

illJ,">1p  H''*’’1?  X1  V 

In(f)  ■ (P1)*5  L \ \ i L.  d3fi...*L.  dX 

p » • • • » ip  » • • • » *p  J J ^ 

* (pO**  Ij  i a;  i £■; 


£(ip(f)/V..,y  - (pd1* . J'  ai1 ^ E(cii5...5e1^/cr....y 

- (p!)55  ? a.  . q • 


.lence  we  nave 


r 
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(2.1) 


V*> 


lin  (pi)  i l a. 
rr*»  1’ 


a.s. 


flow  by  choosing  a CONS  {£^}  such  tliat  each  can  be  obtained  fron  the  sanple 

paths  of  X,  (2.1)  expresses  I„(f)  as  the  a.s.  limit  of  r.v. ’s  obtainable  fron 

the  sanple  paths  of  X.  One  such  choice  is  the  following.  Consider  a sequence  of 

refining  partitions  of  the  (closed)  interval  T whose  nesh  goes  to  zero  (e.g., 

the  dyadic  partition)  and  denote  by  {t^>  the  corresponding  sequence  of  points 

of  T,  which  fom  a dense  subset.  Then  X.  ■ / 1,.  . 9dX  and  by  orthonoma  - 

ti  tt0»tiJ 

lizing  (X^  } we  obtain  the  COWS  {^}  where  ^ = /^(tJdX^  and  each  d>^  is 

a step  function  (a  linear  combination  cf  1 r I,  ).  Clearly  each 

1J  1 O’  iJ 

can  be  obtained  from  the  sample  paths  of  X (as  a linear  combination  of 


X.  X.  ). 

Z1  "i 

For  the  1 171  J we  have  sir.iilarly  an  expression  like  (2.1)  (with  A9(R) 

P L 

playing  the  role  of  A2(P)  ) and  the  most  natural  choice  of  COWS  {£;^}  in  this 

case  is  the  following.  Let  {fw  } be  any  complete  set  in  L2(T,dt)  and  define 

ni  " fSiW* t^  as  a path  integral  of  a measurable  modification  of  X. 

Then  the  sequence  (n^)  is  complete  in  H(X)  and  by  orthonomalizing  it  we 

obtain  the  COMS  (£^>  where  = /p^(t)Xtdt  as  a sample  path  integral  and  each 

<jw  is  a linear  combination  of  . If  the  eigenfunctions  of  R(t,s)  are 

th 

known  one  may  then  take  <{w  to  be  the  i—  eigenfunction. 
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3.  STOCHASTIC  I iTEGHALS 


In  this  section  we  let  again  X ■ (X^,  teT) , T an  interval,  be  a Gaussian 

process  with  mean  zero  and  covariance  function  R and  we  shall  define  integrals 

of  the  fom  / f(t)aXt  with  f(t)  a stochastic  process  appropriately  defined. 

This  kind  of  integral  was  first  defined  by  ItQ  (1944)  for  X the  b'iener  process. 

he  observed  that  if  the  process  f is  adapted  to  X and  if  the  approximating 

Rienann  sups  are  taken  to  be  of  the  foms  l f(t,J  (X.  -X.  ),  tn<t.<. . . <t  , 

K tk+l  tk  U 1 n 

then  t!ie  usual  argument  in  defining  integrals  can  be  carried  through.  Tiiat 
Wiener  process  is  a Gaussian  martingale  suggests  possible  extensions  of  It6's 
integral  to  martingales  and  to  Gaussian  processes.  The  stocnastic  integral  for 
martingales  was  successfully  defined  by  Meyer  (1962)  and  thoroughly  studied  by 
Xunita  and  Matanabc  (1967).  The  idea  involved  remains  the  sane,  Sut  in  order  to 
extend  ltd's  integral  to  general  Gaussian  processes  one  siiould  take  a rather  dif- 
ferent approach  using  the  tensor  product  structure  of  nonlinear  Gaussian  spaces. 

lre  first  generalize  the  notion  of  A2  spaces  and  define  an  integral  denoted 
by  I f(t)®dXt  . The  details  are  ordtted  since  the  argument  is  analogous  to  that 
in  Section  1.1. 


Let  and  H2  be  Hilbert  spaces.  Let  Xt  be  an  H2 -valued  function  on 

an  interval  T,  and  let  R(t,s)  = <X*.,X  >.,  . Then  R is  a nonnegative  definite 

x s n2 

function  (i.e.,  a covariance  function).  Consider  the  set  S,,.,  of  all  M.- 

i.n-.  1 

i J ^ 

valued  step  functions  on  T,  f(t)  = ^ fp  1^  ^ -j  , (an,bn]  c T,  fn  c ^ . 
Sj.j^  equipped  with  the  binary  function 


<f,C>  ■ JJ  <f(t),g(s)>Fl  u2R(t,s) 
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is  an  inner  product  space.  The  Hilbert  space  A2_H  (R)  is  defined  to  be  the 
coroletion  of  Sj.H  . Note  that  A^,  (R)  reduces  to  A2(R)  when  = R. 

For  f = Ii  1(an,br]  e 5I;M1  » derine 

(3.1)  | f(t)*dXt  = I fn  • (Xjj  -Xa  ). 


(3.2) 


I®  Sj.jj  -*■  : f | — ► J fed::. 


is  a norm-preserving  linear  rap  since 

llj  f®dxl  Ih,»H2  = I l <fn>fm>I]  <Xb‘Xa’  :Cb  *Xa  % 
l c 1 i i n n in  in  Z 

.»'{{  <£(t),£(s)>^  dZR(t»s)  = ||f||j[  _ (?0  . 

g -* 

Thus  I lias  a unique  extension  to  an  isomorphism  on  A2 . ^ (R)  into  H^«H2  . 

It  is  clear  that  the  range  of  I®  is  I!^®!I(AX) , where  H(AX)  denotes  the  closed 
subspace  of  II2  spanned  by  the  increments  of  X. 

'e  remark  that  Theorem  1.1  is  valid  for  the  present  general  case  with  the 
proviso  that  one  should  read  absolute  values  and  usual  products  as  norms  and 
Hn-'-r  products  respectively.  Also,  if  the  I-L- valued  function  X has  orthogonal 
increments  and  dF(t)  ■ | |dXJ  |,2,  , then  A,.,,  (R)  = L,.,,  (dF),  the  Hilbert  space 

of  all  dF- squire  integrable  K-^ -valued  functions  (for  integration  of  H-valued 
functions  see  e.g.  Lang  (1969)  ).  The  following  simple  fact  will  be  used  in  the 
sequel. 


L£  ?iA  3.1.  If  Gp  j p^O,  are  olooed  aubepa.ee a of  and  ■ ®p>Q^p 
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(3.3) 

(3.4) 


= ® (G®H?)  , 

1 1 p;>0  * L 

A7 . Lt  (P)  = • . r 09  • 

piO 


PROOF.  (3.3)  is  clear,  and  (3.4)  follows  fro;i  the  following  facts 

■St./.  c St  ,t  . 5t  ..  i S.  /.  for  n*o  and  ..  * 17  _ . Q 


!I  Gp  c 5I;!Ij  • SI;Gp  1 SI;G(.  for  m. 


ri;Hj  * lJP20SI;G^  • 


ilov/  let  X = CCt>  tcT}  be  a zero  mean  Gaussian  process  with  covariance  FI, 
and  assume  as  in  Section  2 that  Xt  B 0 a.s.  for  some  tQ  e T.  Let  = L2(X) 
ar>d  H2  ■ H(X)  (*  H(AX)) . Then  for  f c (■v-j  (R)  the  integral  I®(f)  = 

/ fCO^dXj.  is  defined  and  belongs  to  L2(X)®H(X).  Tlie  program  is  to  identify 
as  many  elements  in  L2(X)®H(X)  as  possible  with  elements  in  L2(X)  through  a 
suitable  (unbounded)  linear  map  ¥ and  then  define  the  stochastic  integral  of  f 
with  respect  to  X by 


(3. 5)  1(f)  =.  | f(t)dXt  - Y(J  f(t)«dXt)  . 

ifote  that  fcA2.^  ^(31)  nay  be  viewed  as  a ’ second  order  stochastic  process",  and 
each  f(t)  as  an  "L2- functional"  of  the  entire  process  X;  thus  such  f as  need 
not  be  nonanticipating  functionals  of  X. 

u/e  first  define  for  each  pil  a bounded  linear  map 

(3.6)  ¥ : F^?(X)®H(X)  - F^P+1(X) 

P 

as  follows.  Pick  a CONS  {£  , ycT} , P linearly  ordered,  in  H(X).  Then 
({  5?^  „ *Pk)  x 

°p  * **  ‘ **^Yk  J®^Y  ’ ?i+*,,+Pk*P^  YjY^*  • • • *Yk6P»  y^<...<Yj^ j is  a 

complete  orthogonal  set  in  H*^(X)«H(X) . Define  on  by 
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(3.7) 


_ S *-;%  hJ  ■ ^ S • 

•Pl^  „ ®pk 

,,friting  c = £ A®...eE  ■ ana  using  the  facts  that  ||0®£;||,,  a-- 

* Y1  Yk  2 hl*‘2 

I l0l  l-J  |£|  Ij^  and  I l^pl  IjjJj  " (Pi1  ‘ • -pk|)/l>1  * we  obtain 

7 Pi • • • *Py • 

Ik  ®5yII  ~ - j--- 

P y H*P(X)®iim  p! 


(X) 


p !...?k! 

—pi. — lf  Y*Yj 

J jh if  r-Yj  • 


It  follows  tiiat 


llc.p®cYll  s HfpCCp^H  - q^lkp®^!! 


for  some  q e (2,..., p+1).  Note  that  all  elements  on  the  right  hand  side  of  (3.7) 
form  a conplete  orthogonal  set  in  H®P+1(X),  and  for  each  such  element  there  are 
k or  k+1  (s  p+1)  elements  in  corresponding  to  it  depending  on  whether 
y=y.  for  some  j or  not.  It  is  now  clear  that  ¥ can  be  extended  uniquely  to 

J /n»  tr  ** 

a boiTided  linear  nap  with  norm  p+1  from  H*P(X)^1(X)  onto  H®P+1(X)S  and  that 

its  definition  is  independent  of  the  choice  of  a CONS  in  K(X).  It  is  also  clear 

j&o 

tiiat  given  any  Cp+1  e h * (X)  one  can  find  n?  e ri^(X)®H(X)  such  that 

W * s+i  ^ 

0-8)  llhpll  ^ | kp(np)| | 0s  (p+i)**! Ihpl I). 

Ifetice  that,  since  ¥ is  a nany-to-one  nap,  (3.8)  need  not  be  true  for  all 

m e 

Up  e IJ^(X)*N(X). 
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itow  let  fg  be  the  natural  isororphisn  between  R®H(X)  aid  K(X) 

(a®£  -*■  aO . ’7e  then  define  y*  = t0  t>e  t‘ie  from  {®,^g!l®p(X)  }®rI(X) 

«N#  * 4 IV  * 

into  ® (X)  whose  restriction  to  each  is  y . Since 

p2i  P 

| ( y ||  ■ p+1  is  unbounded  in  p,  y*  is  an  unbounded  densely  defined  linear  map 

P 

with  donain 

H*  - * h*P(X)}®H(X)  : l I IVOI  |2<4 

1 p>0  psO  p p J 

where  <j>  = £0>g<l>.p  > 4>p  being  the  projection  of  <f>  onto  a®°(X)®K(X) . It  is 
easily  seen  that  H*  is  a dense  subspace  of  {*  .^i-CX)  }®‘I(X) . Also  it  follows 
from  (3.3)  (left  hand  side  inequality)  that  the  range  of  y*  is  (X) . 

Since  ®p>gTi®p(X)  ~ L9(X),  we  iiave 

(J) 

{ e ifP(X)}®H(X)  ~°  L7(X)®K(X) 
psO  ” L 

denoting  this  isomorphism  by  . Finally  we  let  H = <3>g(d*)  c L2(X)®H(X)  and 
we  define  y on  H to  L2(X)  by 


(3.9) 


y = ««y*o$'A  . 


Tien  the  stochastic  integral  is  defined  by  (3.5),  i.e.,  /f(t)diit  = 1(f)  = 

y(/f(t)®<iXt)  = y»I®(f)  for  all  f c A2  l ^q(R)  such  that  I®(f)  = /f®dX  e H. 

The  set  of  all  such  f’s,  denoted  by  AS.,  n'\ (R) » is  a dense  subspace  of 

A7.t  We  should  point  out  that  the  fact  that  the  stochastic  integral  is 

^.*j2vaJ 

not  defined  for  every  f in  A2,^  q^(R)  is  a consequence  of  the  critical  choice 
of  the  constant  in  (3.7).  We  will  see  that  the  constant  (p+1)  is  the  logical 
one  and  that  A£.j  qq (R)  is  large  enough  to  include  most  integrands  of  interest. 

For  this  we  need  to  introduce  the  following  notation.  Let  P be  the  set  of 
all  polynomials  in  the  elements  of  H(X).  For  each  p 2 0 let  PQ  be  the  set  of 


all  polynomials  in  P with  degree  no  greater  than  p ( PQ  is  the  set  of  con- 
stants). For  each  pal  let  Q be  the  set  of  polynomials  in  P,;  which  are 

ortiiogonal  to  P.._i  , and  let  = Pq  . The  closure  Qp  of  P;)  in  L2 (X)  is 
til 

called  the  p—  horogeneous  chaos.  T! le  following  are  then  clear  or  well  Known 
(e.g.  Kallianpur  (1970),  Weveu  (1968)  ) 


7^  1 ^ for  p*q 

V 


P _ 
(6  0 

p q*0 


(3.10) 


L?(X)  = V = ® ^ 
c paO  ? 

'&m  I s, 


and  that  the  following  is  a COiiS  in  each  <7^  , p>l  v 

( (Px ! * - .PjJ)'1^  (Cy  (5y)  : Px+---+Pi;  = P‘>  k = 1»***iP:  Y1»...»Yker> 

'11  k k 

where  (£y,  YeD  is  a CONS  in  H(X).  Lemma  3.1  and (3. 10)  irply  that 

P 

(3.11)  A-,  rv\(R)  = ® A 2-71  -p  (ft)  * ® A?  7) 

Z'L2w  paO  “’fp  q=0 

The  basic  properties  of  the  stochastic  integral  I = T^I®  * follow 


from  the  following  structure 


4> 


1 


Iw  0 ~ 

A,.,  ,va(R)  * L7(X)®H(X)  - (®  H®P(X))®H(X) 


l2;L0(X) 

tm 

a1,l2(x)«)  ; " : 

125  ,» 

- 5p«KX)  = 


t)>0 


H* 


VJ/*  . ~ <J> 

• lfP(X)  = L2(X)ePr 


onto  p^l 


ir«'(x)®n(x)  — n®p(x)  - v 


onto 


~o+l 


and  are  given  in  the  following 


J'J 


T rorn : 3.2.  The  stochastic  integral  7:  A,.,  rv->(R)  -*•  L- (X)  is  an  unboundc 

t L 0 

densely  defined  closed  linear  map  with  domain  AS  , rn  (R)  and.  range  L~(X)  = 

*,^2  '•A-'  ^ 

7*2 QO®^  • the  set  °f  ill  zero  mean  r.v.  's  in  L2(X).  Hence  every  functional 
6 of  X admits  the  representation 


0 = E(6)  + 


jf(t)dXt 


for  some  (non-unique)  f e A^_L  ^(R).  for  each  p>3,  A2’(L^  c A£  L ^ (R), 

and  hence  ^ p (rj  c (X)(R)*  and  the  restriction  of  the  stochastic  integral 

7 to  A ~.7j  (R)  is  a bounded  linear  map  onto  0+ with  norm  p+1.  If 

£ £ A2;L2(X)(?)  and  £ = EpsO  fp  * £p  € A2i^(R^  then  f € A2;L2(X)(R)  if  and 
only  if  Ip,ol|7(fp)||2  < % and  if  f e Ajjj . L (R)  then  7(f)  = Ip20I(fp). 

PROOF.  It  is  clear  from  (3.12)  and  the  fact  t’iat  for  each  p^O v 

Ii*^(X)»  I(X)  c rf*  that  A0  ~ (R)  c A^  p (X)  (R) . Since  is  a bounded  linear 

nap  with  nom  p+1,  so  is  the  restriction  of  7 to  A7>7r  (R)  and  clearly,  again 

ho 

from  (3.12),  7(a2.^  (R))  = ^ . 

Since  V*  is  onto  ®paH*p(X) , and  ^(®0>lfi®P(X))  = L2(X)gQ0  = L2(X)eP0  = 
L2(X),  it  follows  tliat  7 rcaps  its  dona in  onto  L2(X). 

V/e  now  prove  the  clain  in  the  last  sentence  of  the  theorem.  Let 

f‘A2;L2Mfil>  andwrite  f‘Wp-  % * *2£«'  TheR  f ‘ a!;L2(X)CR) 

is  equivalent  to  e H* , and  since  O^.Ipf)  - ) and 

m i r 

p®P, 

v 

turn  equivalent  to 


each  Oq  •!  (fn)  belongs  to  fT1'(X)«I7(X)  , by  the  definition  of  H*  this  is  in 


I 1 1 V4,o1cI*(£t))IIz  < 00  • 

p;>0  - u p 


But  now  | lyV-I^V  ^ * I |4,0'?p,<!,oloI*(£p5  1 1 = I lUfp)  II-  It  follows  tliat 
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f c A£.^  (x)^  *£  3^  only  if  Ip^ol  I *(fp)  1 1 < r°*  Assuming  now  that 

f e A.,  t , , (R)  it  follows  fron  the  definition  of  ¥*  that 
t W 

1(f)  = = l 4> o y ° $' 1 o i ® ( £ ) = l i(f  ) 

u p>0  p u H psO  ? 

In  order  to  comolete  the  proof  of  the  theorem  we  need  to  show  that  I is 

closed.  Let  fn  ^(1),  £n  - £ “ A2;L2(X) (R) ’ Hfn>  + Q 

in  L2(R).  We  will  show  that  f e t'(I)  and  1(f)  * 0.  Write 


1 - I f„  . ^ ■ l f„  p ; f0.f„  , 

1550  - n>!)  n>"  P "'I 


f A,  x (R)  . 


p>0  v 11  pio  Sl»y  v “»P  ’ ’2 

Since  f € 0(1),  by  the  last  claim  of  the  theorem  (just  shown)  we  have 
l(fn)  = ^>0I(fn  p).  Also  fn  -*■  f implies  that  for  each  fixed  p>0, 
fn  _o  fp  in  h^'Ti  (h) , arid  since  I restricted  to  A2.^(R)  is  bounded  we 
have  I (f  ,_)—►!  (f  ) . 3y  Fatou's  leima  we  have 

115P  n p 

[||I(f)||2=  ^ lin||I(fnp)||2  * lin  II|I(fno)||2  = lim||I(y||  <» 

psO  ? p£0  n n,p  n p*0  n,:  n n 

since  I(f  ) G,  sliowing  (by  the  last  claim  of  the  theorem)  that  f e 0(1). 

Thus  1(f)  - L^o1  (frJ  “d  siting  9 = Ip>0°p+1  > 0?  ^ T’  WC  haVe>  again 
by  Fatou's  lemma, 

InM«v-Viii2-PL1fl|Itw-Vi|12 


n>0 


s lin  l ||i(f  J-e  ,|r  = iH>||r(^)-0||  = o 

n p^O  n,p  ? 1 n n 


showing  that  1(f)  ■ 0,  which  concludes  the  proof. 

The  same  argument  can  be  applied  to  define  spaces  A2.^  ^ (R) 
A*  L (x)^r)  and  the  stochastic  integral  J(f)  = /fCOX^dt  for 


□ 


3C 


f t ^ ^ j-yj  (70 , where  we  assume  accordingly  that  X is  a zero  mean  mean 
sauare  continuous  Gaussian  process.  It  can  also  be  shown  that  XS  . (R) 

A2;L-,(Z)  (T)  and  /£ (t)X^dt  = /f(t)dZt  where  T and  Z are  related  to  R 


and  X as  in  Section  1.1. 

We  now  consider  some  of  the  properties  of  the  stochastic  integral.  First 
we  show  that  It6's  integral  is  a special  case  of  the  general  stochastic  Inte- 
gral defined  here.  The  proof  is  based  on  (i)  of  the  following  lemma  which 
will  be  also  useful  later. 


131  iA  3.3.  ( i)  If  0 c L7(X)  and  r)  c H(X)  are  independent  then 

Y(e®n)  = en. 

(ii)  If  0,o  e K(X)  then  Yfeen)  = 0o  - E(0n). 


PFDQF,  (i)  Assure  without  loss  of  generality  that  E(n  J = 1,  and  let 
(n,  YcT} j r linearly  ordered,  by  a COWS  in  H(X).  By  the  Cameron -hiart  in 
representation  of  0 e L2(X)  there  is  a countable  subset  F'  of  r such  that 


Po'Pl* 


8=1  I l 1 V MIL  «Y  ) ...  H_  (U  ) . 

Y,,£r'  'l yk  Po  pi  Yi  Pic  Y.< 

JL  . . K 


P^o  Pn+p,  + ..  .+p,.=p  Y 


fel 


Y1<...<Yv 


Thus  0 is  a function  of  the  r.v. 's  (o,  ycT'),  and  since  n is  indepen- 

dent of  the  r.v. ’ s (0,  £ „ ycF’}  it  follows  by  an  el  a, lent ary  property  of 
conditional  expectations  tliat  6 is  a function  of  the  r.v.'s  {£  , YeT'}  only 
and  in  fact  0 = e(0/£  , Y^r').  It  then  follows  from  the  series  expansion  of 
0 and  £(Hp  (n)/CY,  Y«r')  = E(Hp  (n))  * 0,  pn*l,  that 

0*1  l l a 1 kH  (£  ) ...  II  (£  ) 

p^O  p.  + . . .+p.  **p  Y-i  *•  • • >Yver'  Yl’’  * 1 1 ' 1 -k  ’k 

tei  * y{<-..<y|; 

" l ep 
pso  p 


(3.13) 
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i 


5 


an-  >*6  h ive  ^ , oaG. 

first  s.iow  that  0«n  £ H cr  equivalently  tliat  Og1(0«n)  = 4> '^(0)®ri  e H*. 
-'ince  4>  (3)  * Ipzo'b  (0O)  > * ^(Qp)  £ *1*^00 » this  is  equivalent  to 

I IK(*‘1(oT>)«n)||2  < 

0 e * 

It  follows  fron  tiie  expression  of  each  0 given  in  (3.13)  that 


■ 1,  x i4  _ 0,p p,.  ®p  3rp 

ce  ) = (pi) 1 x a *'r  * 

Yl’‘ * * ,Yk  Y1  'k 


and,  by  ( J.  7) , that 


(3.14)  7 (0  (0  )®n)  = ((p+l)!>i  \ a 1 * £ ' i5. . .5c' ' xSn 

Yl**  **  *Yk  Y1  Yk 


T ius  v;e  have 


II* 


, -1  ^ . ? f 0,;;.,...  ,p,  •»  2 p,  ! . . ,p,  ! 

(v*n)|1  i K Vjj  1 -w 

■ ll»'1(eil)ll2  - l|e.;||2 

ardhencc-  J^l  |»p(*'1(»J.)«i)  1 12  - Ip20l  |0pl  |2  - ||e||2 

0«n  e H. 

i'ow  fron  the  definitions  of  r,  (3.9),  and  we  Iiave 


< 00 . It  follows  that 


v(3®n)  » 4®7''«"tg1(0®n)  = o«'fft(<s’1(0)®n) 

“ *(  I vjy1  (ej«nl) 

pzO  * 

= l 4>(Y  [O_1(0 J®nJ)  . 


I:or  eac.;  oaO,  using  (3.14)  we  obtain 


3»P1  )•••  »'p> 

~(Vn:)  " 1 \ Yv‘  W 


:V.t5Y,.):1i(n) 


’ 9on 


and  thus  'P C©®n)  - l ^ f,0.n  K On  as  desired. 

2 

(ii)  : low  let  0,11  £ HQ.) , ass.r-’e  a~aia  that  E(n  ) = 1,  and  write 
6 = c(0n)n  + 5 where  c = © - E(0n)n  is  independent  of  n*  Then  0®n  = 

ECSnJn®4  + s®n  and  by  (i),  4' (6»n)  = d(5n)'i'(n®")  + ^n.  3ut  H©®2)  = 
C'f¥i!cO~^(n®7))  ~ Cn®n)  = *(n®n)  = il^Cn)  = n4-l.  Hence 

H'fosn)  = Eton)  (ri2-l)  ♦ {0-E(0n)n)n  = On  - E(0n)  • □ 

T-!5 Ohd\  ’>.4.  Itd:s  integral  for  the  r,iener  process  is  a special  case  of  the 
stochastic  integral  I. 


Pi  .OOP.  Let  7.  be  the  “'iener  process,  i.e.  R(t  ,s',  = t*s . Tien 
internal,  denoted  by  I*,  defines  an  isomorphism  from  or.-.o  L'  (/•) , where  2 
is  :he  Hilbert  sibspace  of  L2(ftxR,  3(X)*3(R),  dPxdt)  = L2 (dPxdt)  consisting  0" 
all  elements  adapted  to  X.  itote  that  L c L-,  (dpxdt)  3 L,  T rv%  (dt)  = 

C.  u 6 jL. y(.^J 

; I 

A-  i Let  M be  the  set  of  all  elements  of  the  font  7,  f L,  K where 

in  lan'DnJ 

f c L,  (X.)  and  5 is  8(X  , usaa)  -measurable . M is  a dense  subspace  of  il2  . 

Vfe  first  show  t.iat  i‘  c L*  . r..  (<.t)  = A5  , ,^01)  and  tnat  1=1*  on  H. 

. “2  ‘ 

Let  f = hd1Can,,c^J  6 1,len 

’*(0  - 

Cince  each  f is  6 (a  , usa  )-rieasurable,  it  is  independent  of  -X  s and 
nun  * °n  ®n 

by  La-na  3.3(i)  fn*G^  -Xft.  )cH  and  ^(f^G^  -Xfi  ))  = £nG^  -*a  )•  It  follows 


n n 


n n 


n n 


1 
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that  If  dX  *»  ^.(X,  -Xa  ) c H,  and  thus  f e L|.L  ^g(dt),  and 


n n 


I(£)  - ¥(/fWX)  = ZifnCXb  -X  ). 

n n 


Hc-nce  Iff)  - I*(f). 


Finally  we  show  that  fL,  <=  Ltj  ^ ^ (at)  and  that  1=1*  on  ti2  • Let 

£eM2  . Then  for  some  fn  € K c l*  L (dt) , fn  f.  It  follows  from  the 

properties  of  Itfi's  integral  that  I* (fn)  -*■  I*(f)  and  since,  as  it  was  just 

shorn,  I*(fn)  = IOEj^.we  liave  I (fn)  ♦ I*(f).  Since  I is  closed  it  follows 
that  f c Li  , rv-(dt)  and  1(f)  = I*(f).  Clearly  K-  is  a smaller  class  than 
Li  T ,,«(dt)  - Ai.  ,v,  (R)  and  thus  I provides  an  extension  of  I*.  □ 

6*^2  c 9 l2  W 

V’e  now  consider  the  problem  of  calculating  the  stochastic  integral  for 
specific  integrands,  starting  with  the  simplest  possible  case  where  f(t)  = 6<J> (t) 
with  9 c L2Q0  and  <{>  t A2(R). 

THEOREM  3.5.  (i)  If  9 € L2(X),  <j>  c A2(R),  and  9 and  /<}>(t)dXt  are 

independent  then 

| - e |*(t)dXt  • 

(ii)  If  9 e I1(X)  and  <|>  e A2(R)  then 

|9d>(t)dXt  - 9 J<{>(t)dHt  - E(9  J<fr(t:)dXt)  • 

(Hi)  If  for  some  ucT,  F(x)  e L2^R,  exp(-x2/2R(u,u))dxj  and  if  F(x) 
has  art  L-fl,  exp (-x2/2R(u,u))dx| -derivative  denoted  by  F:(x),  then 

jFCycOWd^  - F(Xu)|<Kt)dXt  - F'CXu)E(Xu|*(t)dXt)  • 


r 
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PROOF.  We  first  show  that  if  0 e l^fX)  and  $ e A2 (PO  then 


I*(9$) 


<t>(t)dxt 


|(00(t))«dXt  * 0«j 
Indeed,  if  $ is  a sinple  function  $ - I‘icn^^a  b j we  ^iave 

i*(0$)  « i*(fi9cni(a^>b  ])  = gcec^j.cx,,  -x  ) “ 0«J$dx, 

and  since  I®  is  an  isomorphism  the  same  is  valid  for  all  4c  A£(R) . It  follows 
that 

1(0$)  * $e4<*a$*1ol#(0$)  - 1(9)«|$dX)  . 

(i)  Let  f(t)  = 0$(t).  '.Ve  will  show  that  f e At.  r,..(R)  51  V(J)  and 

L >1^2  VAJ 

1(f)  = 0j$dX.  Write  6»Ip^o0?,  fp  ^ • Then  f - ^o0p$  in  A^^R) 
with  each  fp(t)  * 0p$(t)  in  Lz  p-  (R).  We  first  calculate  I(6p$(t)).  1>Jote 
that  it  is  clear  from  the  proof  of  Lemma  3.3(i)  that  the  independence  of  6 and 
/$dX  (=  ncHC 
Lema  3.3 (i) 


/$dX  (=  ncH(X))  implies  the  independence  of  each  0 and  /$dX.  Thus  by 

P 


< 00  . 


I(0?$)  * »«I*(0p«)  3 n0p«|$<LX)  = 0pJ$dX  . 

/'tow  the  independence  of  0p  and  /$ cLC  Lilies  ||I(0p$)||  = | |0p|  |»  | |/$dA|  | 
and  thus 

IQ  llicyll2-  L l|I(V)l|2*pL  l|0Pl|2llI*dxl|2  ■ llell2-ll|4<a|  ' 

It  follows  from  Theorem  3.2  that  f e V(J)  and  that  1(f)  * ][p>0  I(f^)  ■ 
lp*0  Qp  /$<L(,  and  again  by  independence  we  have  1(f)  = 0/$dX. 

(ii)  If  0 e II(X)  and  $ e A2(R)  then  0$  e A2.7T  (R) , and  by  Lema  3.3 (ii) 

1(0$)  - 4'cl*(0$)  - y(0«|$dX)  * oJ$dX  - £(eJ$dX)  . 
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(iii)  First  let  F(X„)  = H 7(X,,),  p£l;  where  a2  = E(X2)  = R(u>u).  Then 

-U  ?>(J4  a j u 

letting  /<J>dX  = n and  noting  that  4>"*(K  7 (X,))  = (p ! ) a®P  we  have 

P’CTu 

H 2(Xu)4.(t)dXt  = ^((poV^n)  . 

p,a 

r u 

v'rite  n = au2E(!^n)Xu  + q where  c « n - a'^EC^n))^  x \ . T en 
'i-pG^n)  - (p+D^o^EC^n)^1  + xj®?} 


and  thus 


[h  7(Xa)4>(t)dXt=o'2E(x  n)H  7(XJ  * H 2(X)c 
J P*°u  P+1=°u  ?’au 

■ 11  2<V"  * <’u2e'xu"){h  , 2cy  - v!  2«u» 

p»au  p+1»au  P'°U 

- K - PECV^”  , 2<V 

P'°U  P-1'°u 

which  is  the  desired  relationship  since  dll  7(x)/ox  = pH  7(x) . 

p,o  P-1,0 

How  if  FfX^)  is  as  in  the  staterent  of  the  theorem  we  have 

peg  - I V1  z^.F'oy-  W 2oy 

P*°  - psau  psl  * p-l>ou 

with  both  series  converging  in  L2(X).  Since  for  each  p^O,  ||l(H  2^^)  1 1 5 

, , P’°u 

(p+l)'5|  | II  2CXu)<t>|  | = (P+1)  s|  |H  2(r^)  1 1 J 1 1 4>|  I , tre  have 
P'au  p,au 

l MlM  2(y^)||2^  I C?+l)a2||H  2Cy  1 12«|  |*|  |2 
p-0  ?p,o;  u p^o  p P,o‘  u 

- (liF'cyu2  + MF(xu)ii2)ikii2  < » . 

It  follows  by  Theorem  3.2  tliat  FfX^H  e P(I)  and 
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l k 

p^O  J r 


pH  2(Xu  )♦(«* 

PP'< 


l 2(Xu)M  ' P'V:  2(XJE(XJ*X)} 

P^O  P P»o.j  J ■ p-1,0*  U ^ 

Fpyjtdx  - F'cyEc^j^g  . 


□ 


(iii)  includes  the  cases  of  liermite  polynomials,  H 20\),  and  exponentials , 

2 * p'°u 

exP (\f '^u) > 311(1  adnits  a natural  generalization  to  Ps  of  the  fom 

P(*\j  , . . . . As  an  illustration  we  write  the  follov/ing  sinple  integral 

1 X 

fynV(t)d;t  “ Vy/^  ‘ - EO^J^dX)}^  . 

Before  evaluating  some  less  trivial  stochastic  integrals  we  consider  the 

follov/ing  interesting  result.  Let  T = [a,b]  and  a = tn  <t,  <...<t  = bs 

u,n  i,n  n,n  5 

11=1,2,...,  be  a sequence  of  partitions  of  T whose  mesh  goes  to  zero, 

nax^ft^  ^-t^  n)  -►  0.  Hie  mean  square  quadratic  variation  of  X on  T along 

suc.i  a sequence  of  partitions  is  defined  as  the  mean  square  limit  of 

L_i  (Xt  - a-.  ) whenever  the  later  exists. 

1 1 ci,n  xi-l,n 

THEQREi  3.5.  Let  X = {X^,  te[a,b]}  be  a zero  mean  Gaussian  process  with 
continuous  covariance  R of  bounded  variation  on  [a,bjx[a,b]  (the.  signed 
measure  on  [a,b]x[a,b3  corresponding  to  P.  is  denoted  again  by  R ) . Then  the 
mean  square  quadratic  variation  of  X on  [a,b]  along  any  sequence  of 
partitions  whose  mesh  goes  to  zero  exists  and  is  given  by 


v?  - Rdf) 


where  D is  the  diagonal  of  [a,b]x[a,b]. 


I 


PROOF,  by  the  nean  square  continuity  of  X and  the  bounded  variation  of  R 
v/e  have  //|<Xt,Xs>|d2|R| (t,s)<®  and  //| <^,61^  g-j(s)>|d2|R|  (t,s)<«>  for  all 
(a, 8]c[a,b]  and  0eL2(X).  It  then  follows  from  the  extended  version  of  Theorem 
1.1  that  Xt  e ^2-I'(v) ^ c and  thus  the  stochastic  integral  /XtdXt  is 

defined. 

Let  a - tg  r<t^  n<...<tn  a = b be  any  sequence  of  partitions  with  mesh 

tends  tc  zero.  If  is  defined  by  = X^  on  each  (t^pt^],  then 

1“1 

->  X in  A2#H(X)^  tiie  mean  square  continuity  of  X and  the  bounded 
variation  of  R ) and  hence  dX,.  -*•  /X^dX^.  in  (X) . Thus,  by  Theorem 

3. 5(ii) , 

(3.15)  fb  X dX  = lin  l fJ  JL  lrt  t l(t)dX 

>a  z z n i=l  Ja  xi-l  lti-l,TiJ  x 

= lin  l (X.  (X  -X  ) - E[x  (X  -X  )]}  , 

n i=l  i-1  i "i-1  i-1  i i-1 

and  similarly,  by  defining  X'^  = Xt  on  (t i_1  ,t^] , we  have 

(3.15!)  f X dX  - lira  £ (X  (Xt  -X  ) - E[X.  (Xt  -X  )]}  . 

U z 1 n i-1  ri  i ri-l  ri  zi  ti-l 

Subtracting  (5.15)  from  (3.151)  gives 

0 - lira  { I (Xt  -X  )2  - l E [ (X  -X  )2]} 

n i=l  zi  zi-l  i-1  zi  zi-l 

and  since  the  second  term  lias  limit  R(D^) , the  result  follows.  □ 

a 

hot ice  that  by  adding  (3.15)  and  (3.15s)  we  obtain 


f V*t  - HVl  - 4 ■ °b  * °a> 


2 2 

where  ot  - E(Xt)  - R(t,t).  A similar  approach  leads  to  the  following  result. 


Ti  SOr . I ■ 3.7.  Let  X he  as  in  Theorem  ?>,G.  Then 

f«  ,txt)ax  - ^./h  2(V-"  , 2CV}>  P20 

' Ja  p,ot  1 p+l,ob  p+i,oa  ' 

| exD(Xt-!sa^)clXt  = - exp(Xg 


. -*s a„)  . 
a a 


PRQQTh  It  is  shown  as  in  the  proof  of  Theorem  3.6  that  H -(X,.)  e 

P>°t 

A? ,tt  (R).  Letting  a = tn  <t,  <...<t  = b be  any  refining  sequence  of 

& i Uyll  .1**1  lijll 

P 

partitions  with  nesh  going  to  zero,  and  using  the  (uniform)  mean  square  continuity 

of  X and  the  bounded  variation  of  R,  we  have  (writing  t.  for  t.  for 

v u i i,n 

simolicity) 

|bH  jC^dXt  - «.*‘.o-1(fb  H 2(XtJ®dXt] 

■'a  p,ot  ua  p,a£  J 

■ I H 2 (Xj.  MXt.-Xj,  )} 

n i p,o  i-l  i i-l 

ri-l 


{ (p+1)  ! 4>{lim  l X®P  Zql  -X  )} 
n i T'i-1  l i-l 

{(p+l)!rs  ${lin  l -4-  j X®n  Sx^ttOL  -X,  )) 

n i p+i  n=0  i-l  wi  xi  xi-l 

f (X* 


n i ms0  i-l  i 


i-l  i 


Ife^j0’5  *flim  I CX?*1  - x!?*1)} 

? 1 n i Ti  ri-l 

»(£>*»  - x^*1)  - £ <H  2(V-H  2(X  )}  . 

pl»°b  P+1>°a 


Tne  second  result  follows  from  the  first  and 
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expC^-ho2)  « Z ij-  H 2(Xt) 

D^J  r p,Ot 


Putting  f (t)  = ip  H -> (X  ) it  is  easily  seen  that 
? p-  P,a*  T 

L Ml(fD)  II2  * 2{||exp(Xb-Jso2)||2  + ||exp(;Ca-^)||2}  < » . 


Thus  by  Theorem  3.2,  expCX^cr2)  e P(I)  and 

f exptv^t)^  ■ lArf"  2«Pdxt 

'a  P&0  1 'a  p,o 

= i 75+itt{h  2<v  - H 2cy> 

p>0  & L>-  p+l.oj  13  p*l,o2  a 
" exp(Xb-J5ap  - exp(Xa-'so2)  . □ 

Theorem  3.7  shows  that  Hermite  polynomials  H 2(}^)  play  the  role  of 

P 

customary  powers,  Xp  , and  exp(X^-Jso2)  the  role  of  the  customary  exponential, 
expQCj.),  in  this  stochastic  calculus. 
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it*:  . *ft:  ’ . : rr • . :va  .r  y T.f'ms 


Throughout  this  section  we  assure  that  X is  as  in  Theorer.  3.6.  We  first 
explore  the  connection  between  the  I’/I's  and  the  stociiastic  integral.  We  want  to 
establish  tliat  each  ;.J/I  can  be  written  as  an  iterated  integral,  i.e. , that  for 

£p  c a2(«Pe), 

1T  •*•  jT  £p(ti,’"’Vdxt1  •••  ^ct„ 3 

= 1T  (It  (“* (It  Vti,'",tP)AV*,,d\JdXtJ 

where  of  course  the  iterated  integral  remains  to  be  defined. 

Let  H be  a Hilbert,  space  and  S^T  the  set  of  all  H-valued  sten  functions 

i;n 

f(t^,...,tp)  on  . Then  is  an  inner  product  space  with  inner  product 

<f,g>  = J.,.Jj  <f (tj, . . . ,tp) , g(Sp . . . »sn)>  d R(t^,s^)  ...  d < (tp,Sp) 

and  its  completion  is  denoted  by  A-.^O’^R).  It  is  easily  seen  that  A,  ,.(®^R)  • 

l j n & )ii 

A9  (®~  R)®!  : under  the  correspondence  ($■.». . ,«L)^  « — ► (c)).®. . .*$_)»£.  Thus  each 

4 i p xp 

element  in  A2  -_j(®^R)  has  an  orthogonal  development  of  the  form 

l y (4>y 

'1'*  ** >Yp  Yj  Yp  a 

where  Y«r)  and  (£a,  acA}  are  COWS's  in  A2(R)  and  H respectively. 

Consider  the  following  c’lain  of  naps 

A (,°R)  i.  A,.,  (•D  lR)  h.  ...  -ti.  A,  - (A)  Li.  Z 


2-\-l 


defined  first  by 
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TT.  TT  2 r f 

* ®...®6  — *■  ( 6 dX)<b  ®. . .®4>  — ► /I  4>(  <J>  dX®  <{>  dX)<t>  ®...®<J>  -*-... 

Y1  Yp  Y1  y2  Yp  J y1  y2  y3  Yp 

{(p-l)!)W<J>  dx5...Sf*  dX) <j>  i (n!)W*  dxS...S[*  dX) 

Y1  Yp-1  Yp  Y1  1 Yp 


{ (p-1) ! } <K k>  dX®...®  <p. 


Then,  by  the  sane  argument  used  for  defining  7 , each  ira  can  be  extended  to  a 

u 

bounded  linear  onto  (not  one  to  one)  map  with  norm  q'2  . It  is  important  to  note 

that  T"  is  the  stochastic  integral,  and  that  on  (T  -.-valued  steo  functions  tt 
p ° ' nq-i  - q 

acts  like  stodiastic  integral  by  fixing  the  ’extra”  variables.  The  iterated 
integral  in  (4.1)  is  nov;  defined  to  be  tt  «... (fn)  and  the  equation  follows. 

Letting  T = [a,b]  and  noting  that  I^(f^)  = I^(?^.) , we  should  expect  to 
obtain  from  (4.1) 

,a  £ fp(ti •••  dxtp= 

• £ w\ 


where  h is  adapted  to  X.  This  will  now  be  made  precise  (in  the  proof  of 

AT 

Theorem  4.2).  Hie  following  definition  will  be  used.  A step  function 

f = ^ fftlj-a  b •)  in  A?  j j-y-j  (R)  is  called  adapted  if  each  fn  is 
ii5  nJ  2V 

fc  (X*.  t a^t^a.  J-iraasurable.  The  closed  subspace  of  A2  ^ qq(R)  generated  by  the 

aj  t 

adapted  simple  functions  is  denoted  by  (X)^  and  its  elements  are  called 

adapted.  We  also  let 

^L2(X)W  ■ fl2?L2CX,®  " A*2.L2P0W  • 

L'Zi'A  4.1.  If  i e A,  (®PP.)  is  a step  function  then  g(t  ) a 
tp  t2  . 

f f ...  f [ f (t, , . . . ,t  , ,t  )dJL  ) . . . dXt  is  an  adapted  step  function  and 

Jo  l Jo  * p P 1 ' P-1 
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(4.2) 


. t. 

||  ...  j.t  )d7  ...d>. 

;a  'a  'a  v 1 1 p 

t t- 

fD  ff  V 2 ^ 1 

...(  f (t-. ., . . . ,t  »t  )dX.  ) . . . dX.  dX 

Ja  Ua  % 1 P 1 V \-lJ  S 


where  both  integrals  are  define''1  in  the  usual  way  as  the  corresponding  integrals 
over  the  entire  interval  of  f(t, ,. . . ,t  )1,  ■,  . 

PROOF.  For  ease  of  exposition  we  only  consider  the  case  p=2,  the  case  of 
p>2  being  sir.ilar.  It  is  then  sufficient  to  prove  the  assertions  for  f of  the 

&m  (i)  (ii)  het,sFti)1(a,8j(t2)- 

(iii)  6 '^1^(0  31^2^  v^'iere  a<(J<Y<6.  Then  gO^)  equals 

(i)  (::R-xa)1(Y,6](t2)>  (ii)  (Xt  "V^a.ej^V’  (iii)  0 ^ is  thus  311  ad2?ted 
step  function.  Using  Theorems  5.5(ii)  and  3.7  we  find  that  the  right  hand  side 

of  (4.2)  equals 

rb 

(i)  JaCVXcx)1(Y,6](t2)dXt2  = (VXa)(X6-V*E[(XS-y  (X6-V] 

= ft  *<(Xp-V*(X6‘V} 

(u)  K-vw^  ■ • C^2 


- W(Xs-Xa)2  - ELCXj-xp2]} 


(iii) 


fb  0 dX.  = 0 . 
U z2 


On  the  other  hand  the  left  hand  side  of  (4.2)  equals 


« 1 2 tl co, e3 tti1 1 or lt2J1  (tj <t2jl  ■ n «rvVs«s-VJ 

• <VV(VY‘E[(VV<VV] 
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(ll)  = iI2  ^ (a , 3]  ^1^ 1 (a , 8]  ^2^  ) 

.-x  i2-Errv  - y i2i 


• ^{tVV*2)  ■ wcy^-ecotg-y2]) 


r2ti(Y16]^tl^1(a!i3]^t2^1(t1<t2)J  “ *2^  = 0 
and  the  proof  of  the  lei/sria  is  complete. 


□ 


— 1 ^^2  (X)  = L2^  ^ thus  each  L2  functional  9 of 

admits  the  stochastic  integral  representation 

6 - E(Q)  = | f(t)dXt 

uliere  (the  not  necessarily  unique)  f is  adapted  (f  £ ... 

2 ;L>2  00  ' 

P^OOF^  It  suffices  to  prove  the  second  assertion  of  the  theorem.  Assure 
first  that  0e<^  so  that  by  Theorem  2.1.  0 = 1.  (fj  * In(?J  for  some 

% « A2(^ro. 


pv  v 


Ij.  9 is  a step  function  in  it  is  easily  checked  that 

l < <t  1 

util  ltir,<,,*<t1r  ' 


and 


Ip(9)  " p!  Jp C^1  (tx< — <tj>) ^ 

where  it  = (ttj ,trp)  is  a limitation  of  (l,...,p)  and  n is  the  set  of  all 

such  pernutations.  itow  let  (9n>  be  a sequence  of  step  functions  in  A2(®PR) 
with  9n  fp  . Then 

llV(t1<...<tp)  * V(tl<...<tp)N  = jrr  Hv^rall 


w 
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iirplies  that  (4>  lr.  •.}  is  Cauchy  and  we  denote  its  limit  by 

1 1 1. 

"W  * 


£ 

W ■ lf  ■ “■ p!  IPtV(t1<...<tn))  - »<  Wet, tp))  ■ 

If  we  let  g^  = ^p.i0*  • • < <t  ))>  then  is  clearly  a step  func- 

tion in  A~,  7t  (R)  adapted  to  X by  Lemma  4.1,  and  by  the  continuity  of  ir  's 

2-Vi  q 

* * v 1 nJ  ^ 

It  follows  that  Ip,  c An  ^ (R)  is  adapted  to  X and  satisfies 

VV  = W - VV  = I(V  • 

For  a general  0 e L~ (X)  we  have  by  Theorem  2.1  and  the  above 
e - EC0)  = I i (f„)  - l Khp  - K I V) 

pal  F * p^l  - p>l  ^ 

'•.here  h = hp  belongs  to  A|  7 (R)  (by  Theorem  3.2,  since 

2 2 * 2 

W’tyir  ■ Ip2ll  |Ij.(fp)||  < 00  ) and  is  also  adapted  to  X since  each 

h_  is.  Q 

It  is  clear  from  the  definition  of  ?,(t, )1,«.  „ ..in  the  proof 

p i p (,t^<...<c^J 

of  Theorem  4.2  and  from  Lemma  4.1  that  equality  (4.2)  is  valid  for  all 
fp  e A2(®;,P)  where  both  integrals  in  (4.2)  are  defined  as  the  corresponding 

integrals  of  ?p(t1 V^V*..^)  * 

He  finally  consider  the  stochastic  integral  of  nonant icipatory  functions.  A 
step  function  f *>  ^nl(a  }>  ] i11  A0. L ^ (R)  is  called  nonantioipatory  if 

each  fn  is  independent  of  the  increments  of  X after  an  . The  closed  sub- 
srx  cc  of  A2  , ^ --j  (P-)  which  is  generated  by  the  nonant  icipatory  step  functions  is 
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I1H 

denoted  by  A.,^  ^ (R)  and  its  elements  are  called  nonant icipatory. 


„na 


TEORH?  4.3.  ^2’L  (v)  c ^2:L  ( ')  ^ stochastic  integral 


Tlcl 

restricted  to  A-,.^  ^ (R)  is  nom  preserving. 


PROOF. 


Let  f = ['V  j-a  -D  j be  a nonant  icipatory  step  function  in 


n'  n 


h-2  tu  (X)  (R) . Since  for  each  n,  fn  is  independent  of  -X&  , it  follows 

2 n n 

from  Theorem  3.5(i)  that 


Then 


1(f)  - { fft}^  - % -x  ) . 

J n n 


ii'mii  ■ i Hwvv’b-v1 

n,m=l  n T\  mm 

For  n=rr.  we  have  Eff^CX^  -X^  )"}  = E(f2)E{ (X^  -Xa  )2}.  For  an  < a^  we  have 

n n n n 

from  the  independence  of  f and  f from  y *X  that 

n m b a 

m ti 

«WVV  \‘V  > ' E<EC  WW  <\-V/*IlV 


n n m m 


n n n n m 


■ E<fnfmCCt\  -Xa  )»b  ’Xa  )/*b  ‘Xa  » 
n n mm  mm 


E{f„£- 


ECCVxa  H7-b  -V3 * 


n n m m 


m 


Et(VXa„ 

m m 


m m rv  v ^2\ 

77J CXb  'a  J f 

) ] m n ' 


E(WE»*b  -xa  HXb  n 


n n n m 


It  follov/s  that 


1(f) 


l , E<fn  VE[(Xb  ‘xa  JOS,  )3 

n,m=l  n n m n 


n n mm 
■ 2 


- ||  <f(t),f(s)>  d2R(t,s)  = ||f||: 

arid  thus  the  stochastic  integral  is  norrr.  preserving  for  step  nonant  icipatory 
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f«  met  ions. 


;*jw  let  fa^a)CR) 


'.'e  will  show  t.’tat  f e A$.^  qq(R)  anu 

2 


L 4< 

| 1(f) | | = | |f| | . By  definition  there  is  a sequence  of  step  nonanticipatory 


functions  £„  such  tiiat  f -*■  f.  Write 
n n 


f ■ -Io  fP  ’ f«  = iof«.P;  Vfn.p‘"2.5; 

l * * 


c A. 


(P)  • 


Then  f — *•  f anu  thus  I (f  — *■  I(f  ).  It  follows  by  Patou's  lema  that 

n,P  n p n,p'  n y 

l nnyn2-  I ita  i!Kf„,)ii2  s ita  i iiHfn p)ii2 

pa 9 p paO  n n paO  Il,p 

g lira  I ll£n  pi  1 2 3 I™  1 1 f n 1 1 2 = I lf  1 1“**  < 00  • 

n paO  >p  n 

Hence  by  Theorem  3.2,  f e A2  L2(X)^*  itow  I |I(fn)-I(£n)|  I = = 

1 1 f -f  | | iirrtlies  that  the  sequence  I (f^)  converges,  and  since  I is  closed  we 

have  Iff)  = lin  7(fn)  and  thus  |)I(f)|J  = lirn)  1 1 (fn) ) I = lin  II £n 1 1 = ll£ll- 

n n 

Hence  A^L  ^ (R)  c A^  L ^ (R)  and  I restricted  to  A? ;L  (X)  (R)  is  a norn 


0 

preserving  nan  into  L2(X) 


□ 


Note  that  7(A^\  £s  a closed  subspace  of  L2(X)  and  it  would  be 

interest  to  lenow  how  large  it  is  in  general,  and  under  what  conditions  we  have 
7 (A-  (x)  (^))  “ ^2  W or  CQ1Jivalently  that  each  L2-functional  of  X has  a 

nonanticipatory  stochastic  integral  representation 


of 


0 - E(0) 


| f(t)dxt 


where  f is  nonanticipatory.  We  conjecture  that  this  would  be  the  case  if  the 
gem  o- fields  of  X are  trivial. 

Tnc  notions  cf  ’adapted"  and  of  ’nonanticipatory"  introduced  above  are  of 
course  identical  when  X is  Wiener  process. 


IMMWNiNPM* 
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5.  1 10.JL IiJEAR  NOISE 


A (strictly)  stationary  process  Y = (Y  , -axt<°c)  with  EY  =0  and  EY  <°° 

is  called  noise.  Quoting  fron  i'JcXean  (1973) , Wiener  (1958)  liked  to  think  of  such 

a noise  as  the  output  of  a ' black  box’ ' 0:  You  put  in  a white  noise 

r'  - , -«xt<«>)  (fornally  the  derivative  of  a Wiener  process  ) and  you  get 

Vq  = 0 (*'t , -®<t<°°)  out;  the  noise  (Yt>  -<*xt<™)  is  produced  by  shifting  the 

inp«t  by  the  flow  of  the  white  noise  f/(«)  -*  $(o+t).  In  order  for  Y to  be  a 

2 

noise  we  require  that  E0=O  and  E0  <°°. 

Since  G lias  the  orthogonal  development  (cf.  Section  2) 


(5.1) 


where  fn  e I^P/),  tlie  noise  Y 
through  the  nonlinear  device  0 


£p (t1 * — » t ) dU 


. d'.J 


-p'-l'  ’ p'  - tj  tp  ’ 

obtained  by  shifting  the  incomijig  white  noise 
can  be  expressed  as 


Yt  " {•••{  VV* tp't^  d?/t1***dWtj)  ’ 

and  t'ne  covariance  function  of  Y is  readily  seen  to  be  (t  = t-s) 


EYtYs 


. ,tp-x)dt^. . .dt 


P * 


Wiener’ s theory  of  nonlinear  noise  starts  from  this  idea.  He  also  proved  a 
profound  theorem  which  was  clarified  by  1-Jisio  (1960)  and  which  states  that  every 
ergodic  noise  can  be  approximated  in  law  by  noises  of  the  form  (5.2).  Note  that 
not  every  ergodic  noise  has  the  representation  (5.2),  and  a necessary  condition  is 
strong  nixing  (liciCean  (197  5)).  (For  a discussion  of  the  ergodicity  of  stationary 
processes  and  processes  with  stationary  increments  sec  T)oob  (1953).) 
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Ibre  generally,  instead  of  sending  white  noise  (or  ,riener  process)  through  a 
nonlinear  device  0,  we  may  send  a Gaussian  process  with  stationary  increments 
X = (''t,  -“Xtc®),  with  say  X^=0  a.s.  and  covariance  R.  Then  the  noise  Y 
obtained  by  shifting  the  incoming  Gaussian  noise  X can  be  expressed  as 


(5-3)  Y 3 l [..•[  f n(t,-t,...,t  -t)JX  ...dX 

c pa  J J P 1 P ci  rn 

where  f^  e A-,  (w^R) , and  the  covariance  function  of  Y is  again  readily  seen  to 

by 

(5.4)HYtYs  = ^ pI{|*  * *{J  ^p(ti»"-'tp^P(Sl"T,‘,,,Sp’T-)d2R(tl’Sl)'”d2R(tp'Sp) 

“ l P!  <C(#f*»°)»  n 

pal  ? P A-  (»Pr) 


where  t = t-s  (cf.  Tlieoren  2.1). 

Although  (5.2)  and  (5.3)  are  intuitively  clear,  they  require  proof.  Hie 
proof  of  (5.3)  follows  from  the  following  property. 


IT  VA  5.1. 

and  covariance 


If  X is  a aero  mean  Gaussian  process  with  stationary  increments 
R then , /or  f e (*^R) , 


w 


V* 


^sJdx+ 


i»  •••»•’ tln'”dxt  n 
i p 


J.  . . Jfp  (t  j“t , . . . , tp*t)dyv^ 


• Ca. 


PROOF.  Both  integrals  are  well-defined  since  X has  stationary  increments. 

«p,  ~ ®Pi 

Pick  a G0M5  {d  , yeD  in  A ,(R).  Since  {<£  ®. . .ed  x:  y. , . . . ,y.  cT, 

y l _ yx  Yk  1 K 

Pj+...+Pk*P»  k^O)  is  complete  in  A2 (Shr)  and  I (fp)  = Ip(?p) , it  suffices  to 


®p,  _ ®p, 

prove  this  assertion  for  f = 6 ®. . .©<s  . But  for  such  f , the  assertion 

P Y1  Yk  P 

becomes 


* 


V 
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i-l  Pi.ll^iir  J 1 1 li  * i-l  Pj.lltill2  J 1 1 v 

and  thus  we  need  only  to  shov-i  that 

| 4>(u)dXu+t  a | ^(urttJciX.j  . 


This  is  true  for  4>eSj  and  hence  for  <J>€A2(R)  . The  proof  is  now  complete.  □ 

Vixen  Y has  representation  (5.3);  we  say  that  Y is  X-presen table.  Note 
that  X is  always  X- presentable  since  Xt  = dX.^  . As  ffcXean  (1973)  sliowed, 
if  Y is  not  strongly  raxing  then  Y is  not  Wiener  process-presentable.  The 
sane  property  is  now  shown  for  X- presentable  processes. 

THbOREH  5.2.  Let  X be  a mean  square  continuous  Gaussian  process  with 
stationary  increments > Xg=0  a.s.t  and  with  absolutely  continuous  spectral  dis- 
tribution. Then  every  'A-pre  sen  table  noise  Y is  strongly  mixing. 

PROOF . Having  introduced  the  Fourier  transform  on  A2(»*5R)  in  Section  1.3, 

the  proof  is  identical  to  ■ cTe'n's  proof  for  X Wiener  process.  Vfe  need  to  show 

R . o 

that  if  R is  the  set  of  all  real  valued  functions  defined  on  R,  and  6(R'  ) is 

R p 

the  a- field  generated  by  the  cylinder  sets  of  R , then  for  A, 3 e 8(R  ) 

lin  Pr(YcAs  YXCB)  = Pr(YeA)Pr(Ye3) 

T-X" 

where  YT  denotes  the  shift  of  Y by  r,  i.e.  Yx  ® Yt+  . In  fact  we  will  show 
that  for  e1>02  c L2(Y) 

lin  Ete.O*)  - E(0,)E(02) 

X-*oo 

where  eT  denotes  the  functional  of  shifted  paths,  i.e.  0T(Y)  - 6(YT).  Then  the 


a 
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strong  nixing  property  is  self-evident.  Since  Y is  X-presentable , L^OO  c 
L2(X),  and  we  can  expand  6p92  as  follows  (i=l>2) 


9i  “ F9i  + f*-|  fi,p(tl’*,*’VdXt1“’dKtp 


where  f.  e A0(»^'R) . Ue  then  have 
1 >p  " 


E(9j6j)  - E(0  )E(02)  ♦ l ?!  <fj  , f*  > 

1 A 1 L pul  i,p  z'p  a2(*pr) 

where  f*  denotes  the  translation  of  f,  by  (t,...,t).  By  Theorems  1.3  and 

1.10, 


<£1  V£2  n*  n * <£1  n’£2  = [. . . fe  1 

1,P  2,1  A.C^Pr)  1,P  2,P  L9(pn)  J J 


£i>P(xi'-  • • » v^2,p(xi**  • • » v (1+xi}  • • • (i+y 2p  (y  • • - p (ydxr  • *dxp 


(wiiere  F is  the  spectral  distribution  of  X ) , which  approaches  0 as  t-*»  by 
the  Riemann-Lebes.tue  tlieoren.  Also 


l ?*  I<£1  p»f2  p>l  5 l p!  I lfi  pl  I I lf2  tsI  I 

pul  pul 


P!(l!f1>pl|2+l!f2aPl|2)  - 4(Var01+Vare2)  < « 

pul 


where  •'"or  each  pul,  norms  and  inner  products  are  in  A2(«PR).  It  then  follows 
that  lin^  E(9le2)  - E(0j)E(e2).  □ 


Me  now  show  the  analogue  of  Wiener- Misio ' s theorem  using  Misio's  approach  as 
simplified  (for  convergence  in  law)  by  IlcKean  (1S73).  X will  be  a zero  mean 
sample  continuous  ergodic  Gaussian  process  with  stationary  increments  which 
satisfies  Xg=0  a.s.  and  tho  following  condition 
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♦ 


(S)  PrtA^X),  Ostsn;  A_.X<0)  > 0 for  all  n2:l 

where  &tX  = Xj.  - Xtl  . 

lllEQIVd  ‘ 5.3.  Every  measurable  ergodic  noise  Y (defined  on  any  probability 
space)  is  the  limit  in  lau  of  a sequence  of  X- presentable  noises. 


PPCOF . Xxanining  ifcXean's  (1973)  proof  for  X the  'Tiener  process  we  see 

that  the  argument  remains  valid.  for  the  present  general  case  if  it  can  be  shown 

that  there  exists  a sequence  of  nonnegative  functionals  an  on  the  paths  of  X, 

such  that  the  probability  distribution  of  each  an  is  absolutely  continuous  and 

its  density  function  is  constant  on  [0,n]  and  decreasing  on  (n.»).  he  proceed 

to  construct  such  a^*s.  For  simplicity  we  sup’xjse  that  X is  a coordinate 

process,  i.e.  (0,3,9)  = (Rh  B(R^),  P)  and  Xt(io)  = w(t).  Consider  S(w)  = 

$ 

ft.  &...u>r>}  . because  o.:  the  continuity  of  the  paths  of  X,  S(w)  is  an 

open  set  a.s.  and  can  therefore  be  exoressed  as  a denunerable  disjoint  union  of 

open  intervals  I^(uj),  ial.  Let 

Sn(w)  * u(Ii(o)):  |Ii(io)|>n,  Ij^^cf-n,*)}  . 

Now  we  sliow  that  Sn(u>)  is  nonempty  a.s.  Let  f(w)  be  an  inteyrable  r.v. 
depending  on  w only  through  its  increments.  Then  by  the  ergodicity  of  X we 
iiave 

lim  — 
r** 


(•a+x 


f(w*)dt  * Ef  a.s. 


where  (t)  a io(t+t).  Put 


f(W) 


1 if  htu>>0,  Ost<n,  A_niu<0 
0 othervfj.se 
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and  a--n.  Then  it  follows  that  3n(u>)  is  nonempty  a.s.  if  Ef>0.  But  indeed 
Ff  = Pr[AtX>0,  0st<n;  A_nX<0]  > 0 by  the  assurption  (S).  Thus  S (u>)  is 
nonempty  a.s.  '/e  now  define  a. (oj)  = n + inf  S_(u).  Note  that  0<a  <®  a.s. 
The  s:ine  argument  as  on  n.  211  of  IJisio  (1960)  shows  that  an  has  the  desired 
probability  distribution.  Thus  the  proof  is  complete.  D 

'/e  now  give  a discussion  of  assumption  (3) . VJe  believe  that  (S)  always 
’olds  when  X is  a zero  mean  sarple  continuous  ergodic  Gaussian  process  with 
stationary  increments , yet  we  are  not  able  to  prove  it.  Instead,  we  have  the 
following  sufficient  condition  for  (5) , which  indicates  that  (S)  is  a nild 
assumption  (if  it  is  a restriction  at  all), 

(Sj)  For  each  n^l  there  is  an  f eR(C),  the  reproducing 
kernel  Hilbert  space  of  the  1 covariance  G of  X, 
such  that  Atfn>0  for  te[0,n]  and  A_nfn<0. 

?J5  i iA  5.4.  (Sj)  implies  (S). 

PBCXIF.  We  owe  this  proof  to  Loren  D.  Pitt.  Note  that  X is  mean  square 
continuous,  since  it  is  a sample  continuous  Gaussian  process.  Thus  R is  con- 
tinuous and  so  is  every  fcR(R).  Assume  (S^) . Then,  by  the  sample  continuity 
of  X and  the  continuity  of  f , 

(loeft:  At(X+cfn)>0,  Ostsn;  A.n(X+cfn)<0)  t ft 
as  c+%  and  hence  there  exists  c>9  such  tiiat 

Pr(At(X+cfn)>0,  Ostsn;  A_n(X+c£n)<0)  > 0 . 

(S)  now  follows  from  the  equivalence  of  the  Gaussian  processes  X and  X+cfn 
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(since  cf  « R(R)  ).  □ 

!Ve  next  show  that  (S.)  is  satisfied  by  all  processes  with  stationary 
increments  having  rational  spectral  densities.  This  implies  in  particular  that 
(S, ) is  satisfied  by  the  v/iener  process,  by  stationary  processes  with  rational 
spectral  densities,  and  by  (indefinite)  integrals  of  stationary  processes  with 
rational  spectral  densities.  The  proof  is  based  on  the  following  result  which  is 
of  independent  interest. 


illvIA  5.5.  A mean  square  continuous  process  X a (X^,  with  zero 

recn  and  covariance  C(t,s)  has  (wide  sense)  stationary  increments  (with  spectral 
measure  dF  ) if  and  only  if  there  is  a mean  square  continuous  measurable  (wide 
sense)  stationary  process  Y = (Y^,  -«*t  •'■»}  with  zero  mean  and  covariance  r(t,s) 
(with  spectral  measure  dF  ) such  that  for  each  t and  s 


(5.5) 


v 

‘s 


Y du  a.s. 
s 


and  K (AX)  = !!(Y).  Also  if  Xg=0  a.s.,  then  feR(C),  the  reproducing  kernel 
Hilbert  space  of  C,  if  and  only  for  some  gcR(r)  and  all  t 


(5.6) 


f(t)  - g(t)  - 


g(u)du  . 


PFPQF.  Tie  sufficiency  of  (5.5)  being  obvious,  we  only  show  its  necessity. 
Sirrpose  that  X lias  the  spectral  representation  given  by  (1.2)  and  (1.3).  Then 
we  have 


h ’ f hr  *x 


C2 


and  K(AX)  = H(AV) . Define  the  process  with  orthogonal  increi.ien.ts 
U « {Ux,  -«xA<°°}  by  (X+i)dbx  - i“1(l+X2)'%'*  dVx  . Then  E|dUx|2  - E | dV^ | 2 = dF(X) 
and  H(AU)  = H(AV) . Define  the  process  Y = (Y .. , -oo<t<<»}  by  Y+  = /e^dU^  . 
Then  Y is  (wide  sense)  stationary  and  mean  square  continuous , and  hence  it  has 


a ’measurable  modification,  denoted  again  by  Y.  First  we  see  that  II(Y)  = H(AU)  = 
'i(AV)  * Ii(AX).  Also  for  each  fixed  t and  s we  have  the  following  equalities 


in  L2  and  thus  also  a.s. 


t itA  isA 
Yxs  ' J — T— 

■ j [(e‘U-elsX)  - 

• h - h ■ r c hYiu)d.:x 

J -<x>  J 5 

■ Yt  • Ys  - f’  V“  • 

The  last  equality  is  justified  by  the  following  equality  for  all  v, 

eD1  i ******  • h]  - L £ °i(l"v)Xdu  dF(x) 

. C f 0i(u-v)idF(X)  4. 

J S J -to 

■ f ECfu7v)*l  - E(f  YU*I  . 7V  ) 

J s s 

where  Fubini's  theoren  has  been  repeatedly  applied,  its  justification  being  quite 


• (A+i)dUx 


• 4.  itA  isA 

lU-e15A}  - hr-  *>, 


clear. 


For  the  second  claim  notice  that  for  all  and  t we  have  by  (5.5) 


E(Xtn)  = E(Ytn)  - E(Y0n)  - j E(Yun)du  . 


(5.7) 


If  £eZ(C ) then 
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f't)  = E (>tn)  for  sene  nel^  ajid  (5.6)  follows  fro?’  (5.7) 
with  g(t)  = E(::t?T)  e R(r) . Conversely,  if  *~e.q(r)  then  "(t)  = E(YJn)  for 
sore  n€L2  . Tons  if  f satisfies  (5.6)  it  follows  fro- , (S.7)  tiiat  f(t)  = 

E (X^n)  and  thus  fe!!(d).  □ 

LZ  ~ ift  5.6.  Let  X be  a zero  mean  mean  square  continuous  process  with  (wide 
sense)  stationary  increments  having  a rational  spectral  density,  and  with  covari- 
ance C.  Than  condition  (Sj)  is  satisfied. 

PROOF . Tins  X is  as  in  Lerea  5.5,  ana  dF  has  a rational  density.  It  is 
then  well  known  that  R(r)  = , the  set  of  all  functions  oossessinq  on  every 

finite  interval  absolutely  continuous  derivatives  up  to  order  r.-l  and  square 
integrafcle  n-th  derivatives  (with  2n  = decree  of  denominator  - degree  of  ninera- 
tor  of  the  polynordals  of  the  rational  spectral  density  ).  :ow  it  is  clear  that 
for  each  fixed  ral,  by  a suitable  choice  of  ge'.C'  , f defined  by  (5.5)  will 
nave  the  desired  property  stated  in  (f,) . Indeed,  for  fixed  nal  we  nsay  choose 
f in  ' ‘2  satisfying  (S,)  and  f(0)=0.  Then  a simle  calculation  s’nows  that  g 
defined  by  r(t)  = uf  (u)  Ju  belongs  to  ’r.;  and  satisfies  (5.  5).  Renee,  by 

Ler-a  5.5.  f«d(C).  Since  f was  chosen  to  satisfy  (Sj)  the  proof  is  complete. 

□ 

Finally  ' ’0  remark  tiiat  Uiener's  (1253)  iscussion  of  the  analysis  anc  syn- 


l 


thesis  of  nonlinear  networks  with  white  noise  input  retains  valid  with  only  minor 
modifications  ror  nonlinear  networks  v/ith  input  a zero  near.  Gaussian  process  with 
stationary  increments. 
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6.  APPO'DIX 

He  state  here  the  basic  definitions  and  properties  of  tensor  products  of 
Hilbert  spaces  (see  for  instance  Neveu  (1963)  ) and  of  Semite  polynomials  which 
are  used  throughout  the  paper. 


5.1 . Tensor  Product  of  Hilbert  Spaces 

Let  FL  and  H2  be  two  Hilbert  spaces  with  inner  products  >.  and 
<•,<’>2  • for  each  h»cFL,  h?eFi2  define  the  nap  rp®h2  ■ FI^xH^-h?  by 

Cn1»h2)(g1,g2)  = <h1,g1>1<h2,g2>2  for  all  gjcHp  g2cH2  . 

If  H * hjn-*®h^ : h^cHp  h2n^cH2>  itel}  then  H is  an  inner  product  space 
under  the  inner  product 

<A.B>-  I l <hf>b8<n>>1<h("hgW>2 

n=l  r=l 

where  A * %‘J  h|n' •Iv^ , 3 = ^ g|‘  ^ • ^*e  Tensor  product  H^®H2  of  11^ 

and  ii2  is  the  completion  of  H with  respect  to  its  inner  product. 

If  (fQ  aeA}  is  co"  lete  (OliC)  i*.  Hj  and  (r, . BeB>  is  complete  (CONS) 
in  H2  then  {fa®gp,  at  A,  Be  8}  is  complete  (CONS)  in  Hj*H2  . If  (X^.SpU^) 
and  (X,,S2,vi2)  are  two  measure  spaces,  then  L2(X^,S^,y^)  ® = 

L2(X1xX2,  p L|ixL|2)  wiTh  corresponding  elements  under  the  isomorphism 

and  f1(x1)f2(x2). 

Similarly  the  tensor  product  H^«. . is  defined  for  p Hilbert  spaces 

, . . . ,Hp  . The  inner  product  is  such  tiiat 

g1»...»Cp>  * <f1»2i>i  •••  <fp»2p>? 
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and  all  properties  carry  over  from  the  case  p=2  to  the  case  of  general  p in 
an  obvious  manner.  If  we  write  or  5 f:>  for  and 

•pf  or  f®*'  for 

For  each  n = (rr^ tt^)  e H , the  set  of  all  v>e mutations  of  (1, . . . „p) , 

there  is  a unique  unitary  operator  on  «Pil  such  that  for  all  eli, 

W-fJ  = -y,  • An  element  f in  ®%  is  called  symmetric  if 

- "i  p ~ 

U f-f  for  all  TTc n_  , and  the  syr, metric  tensor  product  space  or  h®p  is 

T!  P 

the  set  of  all  symmetric  tensors  in  ®PK.  is  a closed  subspace  of  and 

the  operator  (p!)  is  the  projection  operator  onto  «?3tf . Hence 


5Pk  = Set  ir-  l f ®,..®f 

‘ ^ T1  "p 

If  (X,.‘?>,p)  is  a measure  space  and 
functions  in  L2(X^,S^)>p*>)  (i.e.s 
then  J?L2(X,S,p)  * L2(Xp,Sp,yp) . Finally 
then  (e  ®. . ,®e  : y, , . . . ,y_er}  and  (ev 

' 1^  Yp  1 p Y 

sets  in  and  *P'A  respectively. 


» f ^ > • • • > fp£1 1 } • 

L2(Xp,Sp,tr‘)  the  set  of  all  symmetric 
••»aJ  - f(x  ) for  all  TTeJL  ). 

1 p ^ 

if  {e^,  YeT}  is  a complete  set  in  H, 

®. ..»e  : Y-i  > . . • jY^eF)  are  complete 

1 Yn  P 


G.2  i ic-r. ^ite  rolynonials 


Let  X be  a Gaussian  variable  with  zero  near,  and  variance  t.  Applying 

the  Gran-Schridt  procedure  to  orthogonal izc  the  sequence  of  random  variables 
2 3 

1,X,X  ,X  in  L2(X),  we  obtain  the  orthogonal  sequence  Hq  t(X),  Hj  t(X), 

H2  t(X)/  ...  . IL  t is  called  the  Hermite  polynomial  of  degree  p = 0,1,2....  , 
with  parameter  t,  and  is  a polynomial  in  both  variables  t and  X.  The  first 


few  Herniate  polynomials  are 
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